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INTRODUCTION: 


The  purpose  of  the  STEPS  UP  (STepped  Enhancement  of  PTSD  Services  Using 
Primary  Care)  trial  is  to  compare  centralized  telephonic  care  management  with  preference- 
based  stepped  PTSD  and  depression  care  to  optimized  usual  care.  We  hypothesize  that  the 
STEPS  UP  intervention  will  lead  to  improvements  in  (1)  PTSD  and  depression  symptom 
severity  (primary  hypothesis);  (2)  anxiety  and  somatic  symptom  severity,  alcohol  use,  mental 
health  functioning,  work  functioning;  (3)  costs  and  cost-effectiveness.  We  further  hypothesize 
that  qualitative  data  will  show  (4)  patients,  their  family  members,  and  participating  clinicians 
find  that  the  STEPS  UP  intervention  is  an  acceptable,  effective,  and  satisfying  approach  to 
deliver  and  receive  PTSD  and  depression  care. 

STEPS  UP  is  a  six-site,  two-parallel  ann  (N  =  666)  randomized  controlled 
effectiveness  trial  with  3-month,  6-month,  and  12-month  follow-up  comparing  centralized 
telephonic  stepped-  care  management  to  optimized  usual  PTSD  and  depression  care.  In 
addition  to  the  existing  PTSD  and  depression  treatment  options,  STEPS  UP  includes  web- 
based  cognitive  behavioral  self-  management,  telephone  cognitive-behavioral  therapy, 
continuous  RN  nurse  care  management,  and  computer-automated  care  management  support. 
Both  arms  can  refer  patients  for  mental  health  specialty  care  as  needed,  preferred  and  available. 
The  study  uses  sites  currently  running  RESPECT-Mil,  the  existing  military  primary  care- 
mental  health  services  practice  network,  to  access  site  health  care  leaders  and  potential  study 
participants  at  the  6  study  sites. 

If  eventually  implemented,  given  our  findings  we  expect  that  STEPS  UP  will  increase  the 
likelihood  that  military  personnel  with  unmet  PTSD-  and  depression-related  health  care  needs 
will  get  timely,  effective,  and  efficient  PTSD  and  depression  care.  The  real  world  utility  and 
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feasibility  of  the  STEPS-UP  intervention  can  improve  on  what  the  Institute  of  Medicine  has 
described  as  a  15  year  science  to  service  gap.  STEPS  UP  is  available  to  roll  out  immediately, 
reinforcing  and  facilitating  pathways  to  PTSD  and  depression  recovery  within  the  Military 
Health  System. 


BODY: 

Activities  this  year  included  ongoing  project  management,  completion  of  data 
collection,  acquisition  of  administrative  data,  as  well  as  finalizing,  cleaning,  and  producing 
codebooks,  and  analysis  of  manuscripts.  The  project  was  on  pace  in  terms  of  timeline  and 
milestones  according  to  the  approved  Statement  of  Work,  despite  considerable 
administrative  delays  and  uncertainties  in  timeline  and  funding.  Below  we  discuss  each 
task  activity  in  turn. 


Table  1.  Milestones  by  Task 

Year  1 

Year  2 

Year  3 

Year  <■ 

Year  5 

Year  6 

t 

2 

3 

4 

l 

2 

3 

4 

i 

2 

3 

4 

l 

2 

3 

4 

l 

2 

3 

4 

l 

2 

3 

4 

Sept  09 

Dec  09 

Mar  10 

June  10 

Sept  10 

Dec  10 

Mar  11 

June  1 1 

Sept  1 1 

Dec  11 

Mar  12 

June  12 

Sept  12 

Dec  12 

Mar  13 

June  13 

Sept  13 

Dec  13 

Mar  14 

June  14 

Sept  14 

Dec  14 

Mar  15 

June  15 

Task  1:  Develop  Intervention 

Develop  protocol,  tools,  manuals 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Hire  staff  and  conduct  training 

X 

X 

X 

X 

X 

Provider  Interviews  &  Expert  Panel 

X 

X 

Task  2:  Conduct  Randomized  Effectiveness  Trial 

Develop  protocol/instruments 

X 

X 

X 

X 

X 

X 

X 

X 

Obtain  IRB  approval 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Conduct  pilot  test 

X 

X 

Recruit  &  consent  participants* 

X 

X 

X 

X 

X 

X 

X 

X 

Conduct  data  collection 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Analysis  and  Writing 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Task  3:  Create  an  Effective  Research  Structure 

Hold  research  team  meetings 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Implement  QA/QC  procedures 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Submit  reports 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 
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In  terms  of  data  collection,  the  study  team  completed  follow-up  data  collection  in 
October  2014,  keeping  the  data  collection  window  open  slightly  longer  than  planned  to 
capture  the  final  assessments  on  a  few  patients.  Final  follow-up  rates  for  the  666 
participants  in  the  study  are  as  follows  and  are  considered  to  be  excellent  (see  Figure  1): 
93%  overall  3-month  follow-up  rate  (94%  in  STEPS  UP  intervention  ann;  92%  in  OUC 
ann);  90%  overall  6-month  follow-up  rate  (91%  in  STEPS  UP  intervention  ann;  90%  in 
OUC  ann);  and  87%  overall  12-month  follow-up  rate  (88%  in  STEPS  UP  intervention  ann; 
86%  in  OUC  arm).  Final  administrative  datasets  were  received  in  May  2015;  all  institutions 
now  have  access  to  the  eligibility,  baseline,  3 -month,  6-month,  and  12-month  survey 
datasets,  as  well  as  FIRST  STEPS,  M2,  and  MDR  administrative  service  use  datasets. 
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Figure  1.  Study  flow  diagram.  Percentage  in  gray  box  is  response  rate  by  follow-up 
assessment  and  treatment  ann. 


Randomization 

666  (26%) 


Excluded  375(14% 


No  PTSD  or  depression  236 
High  AUDIT  52 

Suicidal  ideation  55 

Other  32 


332  Randomized  to  STEPS-UP  Intervention 
332  Received  STEPS-UP  as  randomized 


334  Randomized  to  Usual  Care 

334  Received  Usual  Care  as  randomized 


3-mo  interview 
312  Assessed 
19  Unable  to  contact 
1  Withdrawn 


3-mo  interview 
306  Assessed 
26  Unable  to  contact 
2  Active  refusal 


6-mo  interview 
Assessed 
Unable  to  contact 
Cumulative  withdrawn 
Active  refusal 


6-mo  interview 

299  Assessed  9* 

32  Unable  to  contact  - 

3  Cumulative  active  refusal 


12-mo  interview 

292 

Assessed  88% 

37 

2 

Cumulative  withdrawn 

1 

Cumulative  active  refusal 

12-mo  interview 
288  Assessed  81 

40  Unable  to  contact  - 

6  Cumulative  active  refusal 


In  terms  of  analysis  and  writing,  the  study  team  continues  to  plan  and  prepare 
publications  and  presentations.  In  November  2014,  a  manuscript  describing  the  overall  design 
and  methods  of  the  STEPS  UP  study  was  published  in  Contemporary  Clinical  Trials  (see 
Appendix  A).  The  primary  outcomes  manuscript  is  under  review  for  publication  (see 
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Appendix  B).  Also,  a  qualitative  study  manuscript  describing  barriers  to  engagement  is  under 
review  for  publication  (see  Appendix  C).  Several  other  planned  manuscripts  are  in  the  analysis 
and  writing  phases.  The  intervention  materials  are  also  in  preparation. 

The  study  team  has  also  presented  multiple  study-related  presentations  and  posters  at 
various  conferences  in  the  past  year,  including  the  Psychological  Health  and  Resilience 
Summit  (September  2014,  Falls  Church,  VA),  the  56th  International  Military  Testing 
Association  Conference  (October  2014,  Hamburg,  Germany),  the  30th  Annual  Meeting  of  the 
International  Society  for  Traumatic  Stress  Studies  (ISTSS;  November  2014,  Miami,  FL),  the 
American  Psychiatric  Association  168th  Annual  Meeting  (May  2015,  Toronto,  Canada),  and 
the  Military  Health  System  Research  Symposium  (MHSRS;  August  2015,  Ft.  Lauderdale, 

FL).  Currently,  presentations  on  the  study  design  and  findings  are  planned  for  the  2015 
Defense  Centers  of  Excellence  for  Psychological  Health  and  Traumatic  Brain  Injury  (DCoE) 
Summit:  Continuum  of  Care  and  Care  Transitions  in  the  Military  Health  System  in  September 
2015  in  Falls  Church,  VA,  two  presentations  at  the  57th  International  Military  Testing 
Association  Conference  in  September  2015  in  Stockholm,  Sweden,  and  multiple  presentations 
and  posters  are  planned  for  the  3 1st  Annual  Meeting  of  the  International  Society  for  Traumatic 
Stress  Studies  (ISTSS)  in  November  2015  in  New  Orleans,  LA.  A  full  list  of  study 
publications  and  presentations  is  presented  below  in  the  “Reportable  Outcomes”  section  of  this 
report. 

In  terms  of  research  team  meetings,  study  investigators  continued  to  participate  in 
multiple  routine  weekly  conference  calls  and  other  communications  as  necessary  to  ensure 
timely  completion  of  all  tasks  throughout  the  year. 

In  terms  of  ongoing  QA/QC  procedures,  during  the  last  year,  continuing  review 
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packages  for  the  lead  WRNMMC  IRB,  Ft.  Bliss,  Ft.  Bragg,  Ft.  Carson,  and  JBLM  sites 
were  approved  by  the  lead  WRNMMC  IRB,  local  site  IRBs,  and  HRPO;  these  packages 
have  a  new  expiration  date  of  07  May  2016.  After  consultation  with  the  local  DDEAMC 
and  lead  WRNMMC  IRBs,  investigators  submitted  IRB  closure  report  packages  for  the  Ft. 
Campbell  and  Ft.  Stewart  sites  because  study  activities  are  no  longer  physically  occurring  at 
the  study  sites.  These  closure  reports  were  approved  by  the  local  DDEAMC  and  lead 
WRNMMC  IRBs  in  May  2015  and  by  HRPO  in  June  2015.  Investigators  plan  to  submit 
IRB  closure  report  packages  for  the  remaining  sites  during  the  next  quarter.  The  University 
of  Washington  IRB  approved  the  study  in  continuing  review  in  August  2014;  HRPO 
acknowledgement  followed  in  September  2014.  Both  the  RAND  and  BVARI  IRBs 
approved  the  study  in  continuing  review  in  September  2014,  with  HRPO  acknowledgment 
following  in  October  2014.  RTI  submitted  for  continuing  review  on  20  April  2015  and 
received  approval.  RAND  recently  completed  the  2015  continuing  review  (approved  on  12 
August  2015),  extending  approval  until  1 1  September  2016,  and  will  be  submitting  to 
HRPO  next.  The  University  of  Washington  IRB  approved  the  study  in  continuing  review 
in  July  2015  and  is  pending  HRPO  review. 

Several  amendments  were  approved  by  the  local  and  lead  WRNMMC  IRBs  during  the 
last  year.  In  September  2014,  the  lead  WRNMMC  IRB  approved  an  amendment  updating  the 
core  protocol  and  DHCC  Data  Safeguarding  Plan  to  remove  language  regarding  the  “Safe 
Harbor  method”  and  describe  the  administrative  service  use  data  being  requested  for  analyses. 
Also,  amendments  to  update  site  personnel  at  the  lead  WRNMMC  site,  Ft.  Bliss,  Ft.  Bragg, 

Ft.  Carson,  and  JBLM  (including  adding  a  new  Site  PI  at  JBLM)  were  approved  with 
continuing  review  packages  in  May  2015. 
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The  STEPS  UP  team  held  a  final  meeting  with  the  DSMB  in  February  2015  to 
discuss  and  review  study  status. 

Specific  Contributions  of  RAND 

In  the  past  year,  RAND  completed  analyses  of  patient,  nurse  care  facilitator,  and 
health  care  provider  interviews  for  the  qualitative  study  portion  of  the  trial.  As  described 
above,  a  manuscript  using  qualitative  study  data  describing  barriers  to  engaging  in  mental 
health  care  within  the  MHS  is  currently  under  review  for  publication,  and  a  second 
manuscript  is  in  preparation.  The  first  manuscript  received  a  request  to  revise  and  resubmit 
at  the  journal  Psychiatric  Services.  Findings  from  the  qualitative  study  were  also  presented 
at  the  30th  Annual  Meeting  of  the  International  Society  for  Traumatic  Stress  Studies  (ISTSS; 
November  2014,  Miami,  FL)  and  the  American  Psychiatric  Association  168th  Annual 
Meeting  (May  2015,  Toronto,  Canada),  and  will  be  presented  as  part  of  a  symposium  at  the 
Defense  Centers  of  Excellence  for  Psychological  Health  and  Traumatic  Brain  Injury 
Summit:  Continuum  of  Care  and  Care  Transitions  in  the  Military  Health  System  in  Falls 
Church,  VA  in  September  2015.  RAND  investigators  continue  to  be  involved  in  all  aspects 
of  the  data  analysis  and  project  management. 

RAND  has  continued  to  be  actively  engaged  in  obtaining  administrative  data, 
working  with  HJF  and  RTI  to  develop  procedures  for  data  storage  and  transfer,  prepare  and 
clean  datasets,  and  analyze.  During  the  past  year,  several  iterations  of  FIRST  STEPS,  M2, 
and  MDR  datasets  were  received  and  cleaned;  complete  FIRST  STEPS,  M2  and  MDR  data 
have  now  been  received  and  cleaned  for  analysis.  In  addition,  RAND  is  leading  the  cost- 
effectiveness  analysis;  this  work  is  underway,  with  complete  data  available,  including 
gathering  information  on  typical  time  spent  on  aspects  of  the  intervention  that  are  not 
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captured  in  the  medical  records  (i.e.,  phone  calls,  documentation).  RAND  also  developed 
variables  with  the  MDR  dataset  for  the  cost  effectiveness  and  service  utilization  papers. 

Also,  RAND  led  the  effort  to  impute  missing  data  for  use  by  the  investigative  team  and 
developed  10  datasets  that  fill  in  missing  items  through  imputation  for  use  by  the  project. 
Administrative  Delays 

All  three  organizations  (HJF,  RAND,  and  RTI)  experienced  administrative  delays  in 
negotiating  the  budget  for  the  allowable  one-year  extension  without  funds  (EWOF).  It  was 
clear  early  on  that  investigators  would  need  an  extension  to  conduct  analyses  and  complete 
study  deliverables,  primarily  due  to  extensive  administrative  delays  in  the  beginning  of  the 
study  period.  However,  there  was  an  extended  process  in  negotiating  the  extension  officially 
from  late  February/early  March  2014,  until  23  January  2015These  administrative  delays 
substantially  slowed  investigator  capability  to  analyze  data  and  initiate  dissemination  efforts. 
HJF,  RAND,  and  RTI  requested  a  second  EWOF  in  order  to  complete  approved  analyses 
and  reporting  activities  for  the  study.  USAMRAA  issued  notification  in  August  2015  that  an 
additional  6-month  EWOF  would  be  granted  which  extends  the  award  period  of  performance 
through  29  February  2016. 

KEY  RESEARCH  ACCOMPLISHMENTS: 

The  specific  aims  of  this  project  were  as  follows: 

Aim  1:  To  assess  whether  active  duty  primary  care  patients  with  PTSD  and/or  depression 
randomly  assigned  to  12  months  of  STEPS  UP  will  report  significantly  reduced  PTSD  and 
depression  symptoms  (primary  outcomes)  compared  to  those  randomly  assigned  to  optimized 
usual  care. 
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Aim  2:  To  evaluate  whether  active  duty  primary  care  patients  with  PTSD  randomly  assigned 
to  12  months  of  STEPS  UP  will  report  significantly  reduced  symptoms  of  anxiety  and  somatic 
symptom  severity,  alcohol  use,  mental  health  functioning,  and  work  functioning  (secondary 
outcomes)  compared  to  those  randomly  assigned  to  12  months  of  optimized  usual  care. 

Aim  3:  To  examine  whether  active  duty  primary  care  patients  with  PTSD  and/or  depression 
randomly  assigned  to  12  months  of  STEPS  UP  have  significantly  lower  direct  and  indirect  costs 
of  care  and  a  more  favorable  cost-effectiveness  ratio  (tertiary  outcomes)  compared  to  those 
randomly  assigned  to  12  months  of  optimized  usual  care. 

Aim  4:  To  use  state-of-the-art  qualitative  methods  to  examine  participant,  clinician,  care 
manager,  and  family  member  perceptions  of  STEPS  UP  as  well  as  associated  intervention 
outcomes. 

As  of  August  2016,  we  can  report  on  Aims  1  and  2,  and  partially  report  on  Aim 
4,  although  at  the  time  of  this  report,  all  findings  were  still  undergoing  peer  review  and  are  not 
yet  published.  Thus,  they  must  be  considered  preliminary.  For  Aim  3,  we  obtained  the 
necessary  data  in  May  2015  but  do  not  have  analyses  or  results  to  report  at  the  time  of  this  report. 
For  Aim  4,  we  have  a  second  paper  underway,  but  results  are  not  yet  available. 

In  regard  to  Aim  1,  we  found  that  compared  to  usual  care,  participants  in  the  STEPS  UP 
intervention  ann  reported  significantly  greater  reductions  in  PTSD  and  depression  symptoms 
over  12-months  of  follow-up  as  shown  in  Table  2.  Differences  in  effects  were  statistically 
significant  at  12-months  for  PTSD  and  at  6-  and  12-months  for  depression.  The  STEPS  UP 
intervention  was  also  associated  with  clinically  significant  improvements  (for  every  12  patients 
(with  PTSD)  or  1 1  patients  (with  depression),  we  see  a  50%  improvement  in  symptoms). 
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Table  2.  PTSD  and  depression  related  outcomes  among  study  patients. 


CACT 

Usual  Care 

Measure  (95% 

Outcome 

(n=332) 

(n=334) 

Cl) 

p-value 

PTSD  (PDS)  Severity 

0  to  3  months 

-2.951  (0.53) 

-2.73  (0.54) 

-0.23  (-1.72,1.26) 

0.59 

0  to  6  months 

-4.86  (0.61) 

-3.42  (0.60) 

-1.43  (-3.11,0.25) 

0.057 

0  to  12  months 

-6.07  (0.68) 

-3.54  (0.72) 

-2.53  (-4.47,-0.59) 

0.0029 

Depression  (SCL-20) 

0  to  3  months 

-0.291  (0.04) 

-0.20  (0.04) 

-0.08  (-0.19,0.03) 

0.062 

0  to  6  months 

-0.44  (0.05) 

-0.25  (0.05) 

-0.19  (-0.32, -0.06) 

0.0007 

0  to  12  months 

-0.56  (0.05) 

-0.31  (0.05) 

-0.26  (-0.41,-0.11) 

<0.0001 

>50%  Improvement,  PTSD 

0.023 

0  to  3  months 

11.5"  (36) 

9.5  (29) 

1.25J  (0.74,2.09) 

0.40 

0  to  6  months 

19.3  (58) 

13.4  (40) 

1.55  (0.99,2.40) 

0.0510 

0  to  12  months 

25.0  (73) 

17.0  (49) 

1.62(1.08,2.43) 

0.0194 

>50%  Improvement,  Depression 

0.014 

0  to  3  months 

12.2“  (38) 

10.8(33) 

1.14J (0.70,  1.88) 

0.60 

0  to  6  months 

21.3  (64) 

13.8(41) 

1.70(1.11,2.61) 

0.0149 

0  to  12  months 

29.7  (86) 

20.6  (59) 

1.65  (1.13,2.42) 

0.0100 

mean  (SE) 

“  percent  improved  (number  improved) 
odds  ratio  (95%  confidence  limits) 
PDS=PTSD  Diagnostic  Scale 


10 


SCL-20=Hopkins  Symptom  Checklist,  20  item  depression  screen 


In  regard  to  Aim  2,  we  also  detected  significant  changes  in  several  secondary  outcomes 
as  shown  in  Table  3.  STEPS  UP  intervention  arm  was  significantly  associated  with  decreased 
physical  symptom  burden  (as  measured  by  the  PHQ-15),  improved  mental  health  functioning  (as 
measured  by  the  SF-12  mental  component),  but  no  changes  in-for  alcohol  consumption  (as 
measured  by  the  AUDIT-C),  physical  health  function  (as  measured  by  the  SF-12  physical 

component)  or  pain  ( intensity  and  interference)X¥Z. 


Table  3.  Changes  in  secondary  outcomes  among  study  patients  from  baseline  to  each  follow-up 
assessment. 


CACT 

Usual  Care 

Measure  (95%  Cl) 

Overall  P  Value 

(n=332) 

(n=334) 

AUDIT-C,  mean  (SE) 

0.24 

0  to  3  months 

-0.26  (0.12) 

-0.29  (0.12) 

-0.04  (-0.28,  0.36) 

0  to  6  months 

-0.34(0.13) 

-0.33  (0.12) 

-0.001  (-0.35,0.35) 

0  to  12  months 

-0.54  (0.14) 

-0.20  (0.14) 

-0.33  (-0.72,  0.06) 

PHQ-15,  mean  (SE) 

0.0252 

0  to  3  months 

-1.12(0.25) 

-0.58  (0.25) 

-0.53  (-1.22,0.15) 

0  to  6  months 

-1.56(0.26) 

-0.69  (0.29) 

-0.88  (-1.64,  -0.11) 

0  to  12  months 

-2.29  (0.33) 

-0.92  (0.31) 

-1.37  (-2.26,  -0.47) 

SF-12,  mean  (SE) 

Physical  (PCS) 

0.65 
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0  to  3  months 

-1.02  (0.41) 

-1.16(0.44) 

0.14  (-1.04,  1.31) 

0  to  6  months 

-0.64  (0.45) 

-1.10(0.46) 

0.46  (-0.80,  1.72) 

0  to  12  months 

-1.11  (0.47) 

-1.25  (0.55) 

0.14  (-1.29,  1.57) 

Mental  (MCS) 

0.014 

0  to  3  months 

4.31  (0.65) 

4.13  (0.65) 

0.18  (-1.62,  1.98) 

0  to  6  months 

5.78  (0.74) 

3.51  (0.74) 

2.28  (0.23,  4.33) 

0  to  12  months 

8.10(0.80) 

4.93  (0.82) 

3.17(0.91,5.42) 

Pain  Intensity,  mean  (SE) 

0.32 

0  to  3  months 

-0.17(0.13) 

0.02  (0.11) 

-0.19  (-0.51,  0.14) 

0  to  6  months 

-0.18(0.13) 

0.08  (0.13) 

-0.26  (-0.61,0.10) 

0  to  12  months 

-0.25  (0.15) 

0.08  (0.12) 

-0.33  (-0.74,  0.07) 

Pain  Interference,  mean  (SE) 

0.36 

0  to  3  months 

0.09  (0.19) 

0.27  (0.13) 

-0.17  (-0.54,  0.20) 

0  to  6  months 

-0.05  (0.15) 

0.18(0.14) 

-0.23  (-0.63,0.18) 

0  to  12  months 

-0.19(0.16) 

0.20  (0.17) 

-0.39  (-0.85,  0.07) 

AUDIT-C=Consumption  items  of  the  Alcohol  Use  Disorders  Identification  Test 
PHQ-15=Patient  Health  Questionnaire  somatic  symptom  severity  score 
MCS=SF-12  Mental  Component  Summary  score 
PCS=SF-12  Physical  Component  Summary  score 

We  also  examined  three  symptoms  of  suicidality  (for  questions  of  “hopelessness  about 
the  future,”  “thoughts  of  death  and  dying,”  and  “thoughts  of  ending  one’s  life”)  that  are  part  of 
the  depression  measure,  and  found  that  these  were  significantly  reduced  in  the  STEPS  UP 
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condition  as  well.  Specifically,  repeated  measures  analysis  (treatment  group,  by  time,  and  their 
interaction)  revealed  statistically  significant  reductions  in  suicide-related  SCL-20  items  in  the 
STEPS  UP  ann  (versus  no  change  in  usual  care)  for  “hopelessness  about  the  future”  (p=0.04), 
“thoughts  of  death  and  dying”  (p=0.003),  and  in  “thoughts  of  ending  one’s  life  (p=0.04). 

To  further  understand  the  findings  in  Aims  1  and  2,  we  also  examined  the  process  of  care. 
We  found  that  the  STEPS  UP  intervention  was  also  significantly  associated  with  more  telephone 
contacts  and  more  months  on  an  appropriate  PTSD  and  depression  medication  than  the  usual 
care  group  as  noted  in  Table  4. 


Table  4.  Patient  reported  mental  health  service  use  by  treatment  group  (mean,  SE). 


Treatment  Effect 

CACT 

Usual  Care 

Measure  (95% 

(n=332) 

(n=334) 

Cl) 

p** 

Individual  Therapy  Visits 

0.49 

3  months  prior  to  enrollment 

2.66*  (0.27) 

2.68  (0.45) 

-0.02  (-1.06,  1.01) 

0  to  3  months 

2.94  (0.26) 

2.86  (0.26) 

0.08  (-0.62,  0.79) 

3  to  6  months 

2.82  (0.29) 

2.32  (0.24) 

0.50  (-0.24,  1.24) 

6  to  12  months 

3.66  (0.47) 

3.55  (0.41) 

0.11  (-1.11,  1.33) 

Telephone  Contacts 

<0.0001 

3  months  prior  to  enrollment 

1.53  (0.14) 

2.56  (0.63) 

-1.03  (-2.30,0.25) 

0  to  3  months 

3.05  (0.22) 

1.76  (0.13) 

1.-29  (0.80,  1.79) 

3  to  6  months 

2.72  (0.31) 

1.46  (0.13) 

1.26  (0.59,  1.92) 

6  to  12  months 

3.30  (0.35) 

1.99  (0.22) 

1.31  (0.51,2.12) 
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Months  of  Depression  Medication' 

0.0129 

3  months  prior  to  enrollment 

0.67  (0.06) 

0.77  (0.06) 

-0.10  (-0.26,  0.07) 

0  to  3  months 

1.30  (0.07) 

1.13  (0.08) 

0.16  (-0.05,  0.37) 

3  to  6  months 

1.37  (0.08) 

1.22  (0.08) 

0.15  (-0.07,0.37) 

6  to  12  months 

2.42  (0.16) 

2.02  (0.16) 

0.40  (-0.05,  0.84) 

Months  of  PTSD  Medication*' 

0.0122 

3  months  prior  to  enrollment 

0.47  (0.05) 

0.51  (0.06) 

-0.04  (-0.18,0.11) 

0  to  3  months 

1.05  (0.07) 

0.85  (0.07) 

0.20  (-0.003,  0.39) 

3  to  6  months 

1.20  (0.08) 

0.88  (0.08) 

0.32  (0.10,0.53) 

6  to  12  months 

2.03  (0.16) 

1.60  (0.15) 

0.43  (0.003,  0.86) 

1  Any  antidepressant  medication 

'  Any  selective  serotonin  reuptake  inhibitor  or  prazosin 
*  mean  (standard  error) 

**  p  for  treatment  difference  averaged  over  3-,  6-,  and  12-month  assessments 

Finally,  we  also  examined  adverse  events.  There  were  no  participant  deaths  and  no 
psychiatric  emergencies  or  hospitalizations  detennined  to  be  study  related. 

In  regards  to  Aim  4,  we  have  one  paper  under  review  that  examines  patient  and  provider 
perspectives  on  the  STEPS  UP  intervention  (see  Appendix  C).  Specifically,  the  study  included 
patients  recruited  for  the  study,  health  care  providers  working  within  site  clinics,  and  the  care 
managers  employed  within  the  study  to  implement  the  intervention  protocol. 

Results  of  the  qualitative  analysis  raised  a  number  of  issues,  which  fell  into  two  main 
categories:  structural  factors  associated  with  the  system  itself  and  institutional  attitudes  and 
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cultural  issues  across  the  U.S.  military.  Structural  issues  included  concerns  about  the  existing 
capacity  of  the  system,  for  example  whether  there  were  enough  providers  available  to  address  the 
populations’  needs  and  the  constraints  on  clinic  hours  and  scheduling  practices.  The 
institutional  attitude  and  cultural  issues  fell  into  two  main  areas:  attitudes  and  perceptions  among 
the  leadership  and  the  concern  that  those  attitudes  could  result  in  negative  career  repercussions 
for  those  who  access  care. 

The  findings  reveal  that  despite  these  significant  efforts,  stakeholders  within  the  Anny 
medical  system  still  perceive  significant  barriers  to  care.  Efforts  to  ensure  adequate,  timely,  and 
quality  access  to  mental  health  care  for  service  members  will  need  to  appropriately  respond  to 
capacity  constraints  and  organizational  and  institutional  culture. 

REPORTABLE  OUTCOMES: 

Publications: 

Engel,  CC;  Jaycox,  L;  Freed,  MC;  Bray,  RM;  Brambilla,  D;  Zatzick,  D;  Litz,  B;  Tanielian, 

T;  Novak,  LA;  Lane,  ME;  Belsher,  BE;  Rae  Olmsted,  K;  Evatt,  DP;  Vandermaas-Peeler,  R; 
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CONCLUSION: 


This  is  the  first  randomized  trial  to  assess  collaborative  care  for  active  component  military 
personnel  and  one  of  few  trials  to  assess  collaborative  primary  care  for  PTSD.  Results  show  that 
the  centrally  assisted  collaborative  care  model  with  stepped  psychosocial  and  phannacologic 
management  (STEPS  UP  intervention)  is  likely  to  improve  outcomes  of  PTSD  and  depression  in 
military  personnel  within  primary  care.  The  qualitative  study  component  will  help  identify 
patient  and  provider  perceptions  of  barriers  to  accessing  mental  health  care  in  the  MHS  and  help 
evaluate  acceptability  of  the  intervention  across  stakeholder  groups.  Furthennore,  investigators 
are  currently  conducting  cost-effectiveness  analyses,  which  will  help  measure  and  understand  the 
value  of  the  intervention.  Overall,  the  STEPS  UP  intervention  enhancements  are  feasible  and 
implementable  within  the  MHS.  Results  from  the  trial  have  the  potential  to  inform  decisions 
about  providing  mental  health  care  within  the  MHS  and  improving  the  lives  of  service  members. 
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Background:  War-related  trauma,  posttraumatic  stress  disorder  (PTSD),  depression  and  suicide 
are  common  in  US  military  members.  Often,  those  affected  do  not  seek  treatment  due  to  stigma 
and  barriers  to  care.  When  care  is  sought,  it  often  fails  to  meet  quality  standards.  A  randomized 
trial  is  assessing  whether  collaborative  primary  care  improves  quality  and  outcomes  of  PTSD  and 
depression  care  in  the  US  military  health  system. 

Objective:  The  aim  of  this  study  is  to  describe  the  design  and  sample  for  a  randomized  effectiveness 
trial  of  collaborative  care  for  PTSD  and  depression  in  military  members  attending  primary  care. 
Methods:  The  STEPS-UP  Trial  (STepped  Enhancement  of  PTSD  Services  Using  Primary  Care)  is  a  6 
installation  (18  clinic)  randomized  effectiveness  trial  in  the  US  military  health  system.  Study 
rationale,  design,  enrollment  and  sample  characteristics  are  summarized. 

Findings:  Military  members  attending  primary  care  with  suspected  PTSD,  depression  or  both  were 
referred  to  care  management  and  recruited  for  the  trial  (2592),  and  1041  gave  permission  to 
contact  for  research  participation.  Of  those,  666  (64%)  met  eligibility  criteria,  completed  baseline 
assessments,  and  were  randomized  to  12  months  of  usual  collaborative  primary  care  versus 
STEPS-UP  collaborative  care.  Implementation  was  locally  managed  for  usual  collaborative  care 
and  centrally  managed  for  STEPS-UP.  Research  reassessments  occurred  at  3-,  6-,  and  12-months. 
Baseline  characteristics  were  similar  across  the  two  intervention  groups. 

Conclusions:  STEPS-UP  will  be  the  first  large  scale  randomized  effectiveness  trial  completed  in  the 
US  military  health  system,  assessing  how  an  implementation  model  affects  collaborative  care 
impact  on  mental  health  outcomes,  ft  promises  lessons  for  health  system  change. 
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1.  Introduction 

The  2014  Institute  of  Medicine  report,  “Treatment  for 
Posttraumatic  Stress  Disorder  in  Military  and  Veteran 
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Populations:  Final  Assessment”  [1  ]  emphasized  an  urgent  need 
to  expand  Department  of  Defense  (DoD)  and  Department  of 
Veterans  Affairs  (VA)  capacity  for  integrated,  coordinated,  and 
evidence-based  PTSD  care.  The  prevalence  of  PTSD  and 
depression  in  the  U.S.  military  is  estimated  at  13%-18%  after 
deployment  to  Iraq  and  Afghanistan,  with  28%  reporting 
serious  symptoms  of  PTSD,  anxiety,  or  depression  [2,3],  These 
problems  are  significant  contributors  to  military  attrition, 
absenteeism,  misconduct,  and  sick  call  visits  [4-6],  However, 
less  than  half  of  U.S.  military  members  with  PTSD  receive 
mental  health  treatment  [2,3,5,7],  and  only  half  of  those  getting 
treatment  receive  minimally  adequate  care  [3], 

Mental  health  care  in  the  military  is  unusual  in  some  ways. 
Typically,  both  providers  and  patients  work  for  the  military— 
sometimes  even  for  the  same  commanding  officer.  Providers 
consistently  experience  clear  and  competing  obligations  to 
military  and  patient  interests.  Perhaps  not  surprisingly, 
underuse  of  military  mental  health  care  is  associated  with 
military  member  concerns  about  the  potential  for  treatment  to 
harm  to  their  career,  mistrust  of  military  mental  health 
providers,  and  fears  of  negative  reactions  from  leaders  and 
peers  [2,3],  While  the  U.S.  military  health  system  offers 
challenges,  delays  and  barriers  to  PTSD  care  are  a  national 
problem,  with  one  study  estimating  a  12-year  median  time  from 
PTSD  onset  to  first  treatment  [8j.  The  average  term  of  U.S. 
military  enlistment  hovers  near  five  years,  and  therefore  a 
comparable  delay  in  military  mental  health  treatment  is  simply 
too  long. 

Systems-level  “collaborative  care"  is  an  established  method 
of  increasing  the  reach,  quality  and  outcomes  of  mental  health 
care  in  a  variety  of  settings  [9],  Large,  well-conducted  random¬ 
ized  trials  indicate  that  collaborative  care  improves  outcomes 
for  patients  with  depression  and  anxiety  [10-12],  depression 
and  related  suicidal  ideation  [13,14],  depression  and  chronic 
health  conditions  (e.g.,  diabetes,  asthma)  [15],  panic  disorder 
[16],  persistent  physical  symptoms  such  as  chronic  pain  [17-19] 
and  analgesic  management  [20].  Cost-effectiveness  analyses 
suggest  that  costs  associated  with  collaborative  care-related 
improvements  are  within  a  range  considered  acceptable  for 
public  health  improvements  [21  ].  For  PTSD,  however,  there  has 
only  been  one  randomized  trial  of  collaborative  primary  care,  a 
negative  trial  completed  in  VA  [22]. 

Since  2007,  the  Army  has  implemented  collaborative  care 
worldwide  using  the  same  model  tested  in  the  VA  trial  [23,24], 
but  insufficient  access  to  and  quality  of  military  mental  health 
care  remain  a  recurrent  concern  [3,7,25-27],  Despite  implica¬ 
tions  for  current  and  future  wartime  health  system  response, 
there  have  been  no  controlled  trials  of  collaborative  care 
completed  in  the  military  health  system,  a  service  system  with 
the  mission  of  providing  health  care  for  over  9  million  benefi¬ 
ciaries  including  active  duty  military  personnel  and  their  families 
at  a  rising  annual  cost  of  $52  billion  in  2012  [28]. 

A  large  multisite  randomized  effectiveness  trial  is  underway 
comparing  a  scalable,  centrally  managed  primary  care  treat¬ 
ment  package  using  collaborative  care  for  PTSD  and  depression 
(STEPS-UP,  STepped  Enhancement  of  PTSD  Services  Using 
Primary  Care)  versus  a  widely  practiced  and  locally  imple¬ 
mented  primary  care  collaborative  care  model  used  in  the  U.S. 
Army  health  system  (UCPC,  Usual  Collaborative  Primary  Care). 
This  paper  describes  the  design  and  methods  employed  in  this 
trial,  a  six  military  installation  (18  primary  care  clinic) 


randomized  effectiveness  trial  comparing  the  impact  of  12- 
months  of  clinical  intervention  (STEPS-UP  versus  UCPC).  The 
randomized  design  will  offer  a  valid  assessment  of  benefit  for 
new  versus  current  health  system  practice.  The  effectiveness 
design,  aimed  to  equip  leaders  and  policy  makers  with  evidence 
to  guide  decision-making,  is  expected  to  yield  maximally 
generalizable  findings,  relevant  cost-effectiveness  information, 
and  qualitative  assessments  of  related  clinician  and  beneficiary 
views  of  their  care.  In  short,  if  STEPS-UP  demonstrates  superior 
clinical  and  cost  effectiveness  and  is  acceptable  to  patients  and 
providers,  it  will  be  immediately  ready  for  rapid  scaling  and 
implementation. 

2.  Study  design 

2.1.  Interventions 

Both  intervention  arms  involve  elements  of  collaborative 
care.  Collaborative  care  is  a  service  delivery  package  that 
accommodates  empirically  validated  psychotherapies  and 
evidence-based  pharmacologic  approaches.  Collaborative  care 
is  not  a  type  of  psychotherapy  per  se.  Three  or  four  basic 
strategies  are  used  to  increase  consistent  delivery  of  effective, 
guideline-concordant  care  [29,30].  Oxman  et  al.  [31  ]  summarize 
these  in  a  “Three  Component  Model”:  (1)  prepared  primary 
care  practice  using  clinical  tools  for  screening,  diagnosing,  and 
measurement-based  symptom  assessment:  (2)  care  manage¬ 
ment  to  help  clinical  teams  track  treatment  response,  insure 
follow-up  and  continuity  of  care,  and  to  help  patients  adhere  to 
treatment  and  know  their  treatment  options;  and  (3)  enhanced 
mental  health  specialty  care  interface  to  insure  optimal  and 
efficient  expert  consultation  wherein  care  managers  meet 
weekly  with  a  specialist  to  review  their  caseload  and  convey 
recommendations  to  the  primaiy  care  team.  Four  additional 
aspects  of  collaborative  care  include  (4)  telephonic  treatment 
and  communications  for  efficiency  and  to  reduce  patient 
and  provider  burden;  (5)  real  time  registries  for  tracking 
indicators  of  patient  treatment  response;  (6)  stepped  treat¬ 
ment  sequencing  strategies  that  maximize  patient  choice 
and  match  treatment  intensity  to  illness  severity  and  trajec¬ 
tory;  and  (7)  centralized  implementation  to  monitor  perfor¬ 
mance  across  sites,  reduce  variation  and  enhance  scalability 
[30,32-38], 

Table  1  uses  these  7  collaborative  care  elements  for  a 
comparative  view  of  study  treatment  (STEPS-UP)  and  compar¬ 
ison  (Usual  Collaborative  Primaiy  Care,  UCPC)  interventions. 

2.2.  Comparison  intervention:  Usual  Collaborative  Primary  Care 
(UCPC) 

In  2007  Army  primary  care  clinics  began  to  implement  a 
collaborative  care  approach  called  “RESPECT-Mil”  (Re- 
Engineering  Primaiy  Care  Treatment  of  PTSD  and  Depression 
in  the  Military)  based  on  a  sustainable  version  of  the  previously 
described  Three  Component  Model  [31,34].  Dietrich  et  al.  found 
that  the  model  significantly  improved  depression  care  quality, 
treatment  response  and  depression  remission  [34],  In  other 
studies  the  model  showed  sustainability,  and  high  fidelity  was 
associated  with  better  treatment  response  [39].  RESPECT-Mil 
adapted  the  model  to  the  military  and  successfully  tested  for 
military  primary  care  feasibility  [23].  Added  to  the  original  Three 
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Table  1 

Intervention  components— STEPS-UP  versus  Usual  Collaborative  Primary  Care  (UCPC). 


Component 

Steps-up 

UCPC 

1 .  Prepared  practice 

Patient  screening : 

Depression  (PHQ-2),  PTSD  (PC-PTSD),  self-harm  (PHQ-9i) 

Depression  (PHQ-2),  PTSD  (PC-PTSD), 

Self-Harm  (PHQ-9i) 

Diagnostic  aids: 

2.  Nurse  care  management 

Depression  (PHQ-9),  PTSD  (PCL-C) 

Depression  (PHQ-9),  PTSD  (PCL-C) 

Nurse  visit  schedule 

Within  2  weeks  of  referral  and  minimum  eveiy  4  weeks  after 

Within  2  weeks  of  referral  and  minimum  eveiy  4  weeks 
after 

Patient  screening: 

Alcohol  Misuse  (AUDIT-C),  mania  (MDQ) 

None 

Symptom  severity 

Depression  (PHQ-9),  PTSD  (PCL-C),  suicide  risk  assessment 

Depression  (PHQ-9),  PTSD  (PCL-C),  suicide  risk  assessment 

tracking: 

Continuity  monitoring: 

Primary  care,  specialty  care,  military  care  (including  deployments 

and  field  exercises), 

and  civilian  care  (TRICARE,  VA,  other) 

Restricted  to  military  primary  care  practice 

Nurse  skills  training: 

Motivational  interviewing,  behavioral  activation,  problem 
solving, 

and  web-based  decision  support  training 

Web-based  decision  support  training 

3.  Specialty  interface 

Site-level  and  central  enhancements 

Site-level  enhancements  only 

Clinic-based  specialist: 

Present  and  fully  model  integrated 

No  model  integration  if  present 

Case-level  reviews: 

Central  and  site  specialists  (weekly) 

Site  specialist  only  (weekly) 

4.  Stepped  care 

Psychopharmacologic  and  Psychotherapeutic  Options 

Pharmacologic  Options  only 

Self-management: 

Web-based  PTSD  and  depression  self-management  options 

None 

Phone  therapies: 

Phone  CBT  for  PTSD  and  depression 

None 

Face-to-face  therapies: 

Phone  CBT  for  PTSD  and  depression 

None 

5.  Telephone  use 

Phone  CBT,  local  and  central  phone  care  management, 
phone-based  training  and  team  meetings 

Local  phone  care  management 

6.  Registries 

Reports  covering  patient-level  treatment  response  and  aggregate 
caseload  analysis 

Individual  patient  tracking  only 

7.  Implementation 

Centrally  managed 

Site  managed 

Clinical  implementation: 

Central  phone  therapists,  central  case  management, 
centrally  run  case  and  caseload  reviews,  and  centrally  moderated 
peer-supported  learning 

Case-based  review 

Continuing  education: 

Centrally  moderated  and  led 

Site  dependent 

Component  Model  were  routine  primary  care  screening  for 
PTSD  and  depression,  primary  care  diagnostic  assessments  for 
those  screening  positive  (PTSD  Checklist,  or  PCL-C,  for  PTSD;  9 
item  Patient  Health  Questionnaire,  or  PHQ-9,  for  depression), 
and  care  management  for  PTSD. 

When  the  STEPS-UP  trial  started,  all  18  participating 
primary  care  clinics  (6  Continental  U.S.  installations)  and  88 
total  Army  primary  care  clinics  (37  worldwide  installations) 
practiced  RESPECT-Mil,  hereafter  referenced  as  UCPC  Each 
installation  had  a  “primary  care  champion”  overseeing  that 
installation's  program  and  a  “behavioral  health  champion", 
usually  a  psychiatrist,  that  meet  with  all  installation  care 
managers  once  weekly  to  review  their  caseload  and  provide 
feedback  to  primary  care  with  care  manager  assistance.  Patients 
in  UCPC  were  assigned  an  onsite  care  manager.  Care  managers 
were  instructed  to  contact  patients  within  two  weeks  of 
program  referral  and  then  eveiy  four  weeks  thereafter.  They 
were  to  assess  PTSD  and  depression  severity  and  monitor 
adherence  to  primary  care  provider  (PCP)  prescribed  psychoac¬ 
tive  medications  at  each  care  manager  contact.  Patients  followed 
in  mental  health  specialty  care  were  discharged  from  the 
program.  The  only  controlled  trial  of  this  model  was  a  negative 
VA  study  [22], 

2.3.  Test  Intervention:  STEPS-UP  Collaborative  Care 

STEPS-UP  was  designed  as  second-generation  collaborative 
primary  care  for  PTSD  and  depression  in  the  military.  The 
goal  is  to  reduce  PTSD  and  depression  through  reliable 


implementation  of  evidence-based  psychotherapy  and  phar¬ 
macotherapy  practices.  Central  implementation  ensures  that 
the  package  is  delivered  feasibly  and  with  fidelity  across  sites 
and  settings  (military,  civilian,  primary  care,  and  specialty 
mental  health)  and  facilitates  scalability  during  changing 
military  and  population  needs. 

STEPS-UP  builds  on  existing  UCPC  infrastructure  by: 
(1)  enhancing  care  management,  (2)  adding  stepped  psycho¬ 
therapeutic  options,  (3)  using  clinical  registries  to  guide 
treatment;  and  (4)  centralizing  implementation  coordination 
(see  Table  1). 


2.3.3.  Care  management  enhancements 

Care  managers  received  added  patient  engagement  training 
(behavioral  activation,  problem  solving,  and  motivational 
interviewing).  These  skills  helped  care  managers  to  provide 
patient  support,  to  keep  patients  active  and  engaged  in  their  care, 
and  to  help  patients  examine  treatment  options  and  develop 
preferences.  Care  managers  reviewed  treatment  options  using 
one-page  guides  with  patients,  helping  them  consider  medica¬ 
tions,  psychotherapies,  or  both. 

Care  management  was  expanded  beyond  primary  care  to 
other  service  delivery  sectors  and  contexts  (e.g.,  mental  health 
clinics,  TRICARE,  VA,  other  civilian  medical  care,  deployments, 
field  exercises,  change  of  station,  departing  military  service). 
Remote  care  management  was  available  by  phone  for  patients 
following  location  changes  or  as  a  substitute  for  local  care 
managers  when  unavailable. 
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2.3.2.  Stepped  psychotherapies 

To  enhance  patient  access  to  psychotherapies  beyond  basic 
support  from  the  care  manager,  patients  were  afforded  stepped 
psychotherapy  options.  These  included  web-based  cognitive 
behavioral  self-management  [40,41],  psychologist-delivered 
telephone  CBT  [42],  and  face-to-face  specialist  delivered 
psychotherapy.  Care  managers  discussed  with  patients  their 
preferences  for  web,  phone,  or  face-to-face  therapy  repeatedly 
over  time.  Central  STEPS-UP  team  psychologists  delivered 
phone  CBT  using  a  flexible,  modularized  protocol. 

2.3.3.  Clinical  registries 

A  web-based  decision  support  tool  was  used  to  track  patients’ 
PTSD  and  depression  symptom  severity,  to  drive  treatment 
changes,  to  create  registries  for  STEPS-UP  team  review,  and  to 
populate  site-level  performance  tracking  reports.  Care  managers 
enter  data  online  during  phone  conversations  with  patients.  The 
online  platform  guides  the  care  manager  through  visits  and 
insures  appropriate  questions  are  covered.  Data  entered  include 
depression  (PHQ-9)  [43]  and  PTSD  (PCL-C)  [44-46]  symptom 
severity,  symptom-related  difficulty,  medication  and  psycho¬ 
therapy  adherence,  suicide  risk,  behavioral  activation  strategies 
and  goals,  alcohol  use  (AUDIT-C)  [47]  and  bipolar  disorder 
(MDQ)  [48]  screening,  and  military  transitions. 

2.3.4.  Centrally  coordinated  implementation 

Psychiatric  consultation  and  review  were  centralized  in 
STEPS-UP.  STEPS-UP  at  each  site  was  coordinated  and  overseen 
by  a  central  mental  health  team  comprised  of  a  psychiatrist, 
psychologist,  care  manager  and  administrative  support.  Care 
manager  specific  registries  were  centrally  disseminated,  and 
flags  were  generated  for  patients  with  ( 1 )  symptoms  that  had 
not  shown  improvement  (less  than  5  point  improvement  in  the 
8  weeks  since  the  last  treatment  change  or  50%  overall 
improvement  on  PCL-C  and  PHQ-9);  (2)  recent  missed  care 
manager  follow-up  contacts;  and  (3)  impending  health  care  or 
military  transitions  (e.g.,  specialty  care  referral,  deployment). 

The  central  team  and  care  managers  met  weekly  for  two 
types  of  phone  conferences.  One  involved  individual  care 
managers  to  review  patient  specific  data.  Management  recom¬ 
mendations  were  developed  for  patients'  primary  care  providers 
and  care  manager  engagement  strategies  reformulated  for 
patients  transitioning  or  at  risk  of  dropping  out  of  care.  New 
and  acute  patients  were  reviewed  first,  followed  by  unimproved 
patients,  and  then  patients  in  transition.  The  central  STEPS-UP 
psychiatrist  insured  patients  on  medication  received  therapeutic 
doses  and  treatment  duration  or  changed  treatment  if  unim¬ 
proved  after  six  to  eight  weeks  or  if  side  effects  occurred. 
Remaining  time  was  used  to  discuss  patients  in  web  or  phone 
therapy  or  to  discuss  site-level  service  system  problems.  Care 
managers  conveyed  STEPS-UP  team  recommendations  to 
primary  care  providers  and  STEPS-UP  team  members  charted 
notes  for  the  electronic  health  record. 

The  central  team  and  care  managers  weekly  for  a  second 
phone  conference.  In  this  meeting,  site  performance  metrics 
were  reviewed,  discussed  and  lessons  learned;  didactic  training 
was  delivered;  and  peer-support  and  lessons  were  shared 
among  care  managers  to  improve  their  care  management  skills. 
When  system-level  problems  emerged  at  a  site,  the  central  team 
would  consult  with  relevant  site  leaders  seeking  resolution. 


2.4.  Participants 

Participants  were  active  duty  military  members  attending 
one  of  the  18  participating  primary  care  clinics  who  were 
referred  by  their  primary  care  provider  for  care  management 
within  UCPC.  All  primary  care  visits  routinely  involved  initial 
depression  and  PTSD  screening  (PHQ-2,  PC-PTSD).  PHQ-2  and 
PC-PTSD  items  were  dichotomous  (yes/no)  questions.  Either  or 
both  PHQ-2  items  endorsed  ‘yes’  is  a  positive  depression 
screen.  Two  or  more  of  the  four  PC-PTSD  items  endorsed  'yes'  is 
a  positive  PTSD  screen.  Patients  with  positive  screens  routinely 
then  receive  the  PCL-C  and  PHQ-9  to  as  “diagnostic  aids",  tools 
that  the  providers  use  to  guide  assessment,  diagnosis,  and 
treatment  planning.  Involving  the  care  manager  is  a  clinical 
decision  left  to  the  discretion  of  the  provider  and  patient. 
Patients  referred  to  care  management  were  contacted  within  a 
week  by  a  UCPC  care  manager.  After  insuring  the  patient 
(1)  had  private  access  to  computer  and  Internet  and  (2)  antic¬ 
ipated  residing  nearby  for  at  least  six  months,  the  UCPC  care 
manager  would  ask  if  the  patient  would  like  to  be  contacted 
regarding  “research  studies  related  to  ongoing  efforts  to 
improve  the  quality”  of  UCPC.  If  the  patient  assented  to  contact, 
a  STEPS-UP  trial  research  site  coordinator  would  contact  them 
for  a  second  level  screen,  research  informed  consent,  and 
eligibility  assessment.  Any  patient  declining  to  participate  in  or 
excluded  from  the  trial  was  continued  in  UCPC  with  their 
previously  assigned  care  manager. 

2.5.  Inclusion  and  exclusion  criteria 

For  inclusion  participants  (1)  were  on  active  duty  at 
enrollment;  (2)  met  DSM-IV-TR  criteria  for  PTSD  using  the 
PCL-C  or  depression  using  the  PHQ-9  (explained  below); 

(3)  reported  computer,  Internet,  and  e-mail  access;  and 

(4)  provided  informed  consent  to  participation.  At  first 
deployment  since  2001  was  required  for  inclusion  but  was 
dropped  after  the  first  month.  The  rationale  for  dropping  this 
inclusion  criterion  was  that  participants  with  PTSD  and 
depression  could  benefit  from  collaborative  care  whether  or 
not  symptoms  followed  deployment.  Furthermore,  assuming 
effectiveness,  benefits  summed  over  a  larger  proportion  of 
patients  would  yield  more  favorable  cost-benefit  calculation 
given  the  system-level  intervention. 

Military  members  meeting  inclusion  criteria  were  excluded  if 
they  had  (1)  recently  participated  in  UCPC;  (2)  active  alcohol 
dependence;  (3)  active,  unstable  suicidal  ideation  or  an  attempt 
within  the  prior  month;  or  (4)  anticipated  deployment, 
demobilization,  change  of  station,  or  separation  from  military 
service  within  six  months.  Initially,  those  undergoing  medical 
retirement  proceedings  (“medical  board")  were  excluded.  The 
exclusion  was  dropped  in  the  first  month  of  recruitment  because 
it  was  frequent  and  inclusiveness  was  important  for  sample 
generalizability.  Instead  the  plan  is  to  eventually  assess  this  as  a 
potential  modifier  of  intervention  effect. 

2.6.  Eligibility  screening  and  informed  consent 

A  web-based  research  reporting  system  was  used  to 
administer  research  assessments  and  establish  trial  eligibility. 
Following  informed  consent,  simple  eligibility  items  and  demo¬ 
graphics,  the  following  instruments  establish  study  suitability: 
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(1)  the  PTSD  Checklist-Civilian  Version  (PCL-C)  where  PTSD  was 
operationalized  as  a  “moderate”  or  greater  severity  level  on  1  re¬ 
experiencing,  3  avoidance,  and  2  hyperarousal  symptoms, 
consistent  with  the  DSM-IV-TR  criteria  (Civilian  Version  of  the 
PCL  was  used  rather  than  the  Military  Version  because  the  latter 
is  used  in  UCPC  and  because  enrollment  for  PTSD  due  to  any 
trauma  (not  solely  military  trauma)  was  the  focus  [44-46]; 

(2)  the  Patient  Health  Questionnaire-9  (PHQ-9)  where 
depression  was  operationalized  as  endorsement  of  at  least 
5  of  the  9  symptoms  experienced  “more  than  half  the  days”  and 
at  least  one  of  those  symptoms  including  either  “little  interest 
or  pleasure  in  doing  things”  or  “feeling  down,  depressed  or 
hopeless,  consistent  with  DSM-IR-TR  criteria  [43];  (3)  the 
Mini  International  Neuropsychiatric  Interview  (MINI)-Plus— 
Suicidality  Module  (C1-C6)  where  individuals  scoring  greater 
than  9,  regarding  suicidal  ideation  during  the  past  2  months, 
were  excluded  from  the  participation  (details  below)  [49];  and 
(4)  the  Alcohol  Use  Disorders  Identification  Test  (AUDIT) 
where  individuals  scoring  >15  were  excluded  consistent  with 
ICD-10  definitions  of  potential  alcohol  dependence  symptoms 
[47],  Research  site  coordinators  oversaw  eligibility  assessment 
in  their  offices.  UCPC  care  managers  were  informed  for 
ineligibles  and  acute  care  was  obtained  as  indicated  to  those 
with  active  suicide  risk  or  alcohol  dependence.  A  study  mental 
health  specialist  was  on  call  at  all  times  for  psychiatric 
emergencies. 

2.7.  Randomization  and  research  follow-up  procedures 

In  most  cases  once  the  site  coordinator  informed  partici¬ 
pants  that  they  were  eligible,  they  continued  directly  into  the 
questionnaire  (some  finished  later  or  from  home).  On  com¬ 
pleting  the  baseline  assessment,  the  automated  system  ran¬ 
domized  participants  (stratified  by  site)  to  STEPS-UP  or  UCPC. 
Participants  were  told  that  their  care  manager  would  contact 
them  within  a  week  and  reminded  of  future  study  team 
contacts  for  the  3-,  6-,  and  12-month  research  assessments.  The 
latter  were  completed  using  direct  computer  entry  over  the 
Internet  from  a  location  of  their  choice,  eliminating  the  need  for 
blinded  assessors. 

Research  follow-up  assessment  reminders  began  30  days 
prior  to  the  3-,  6-,  and  12-month  mark  and  continued  for 
60  days  past  that  mark.  Thus,  participants  were  in  each  follow-up 
window  for  a  total  of  90  days.  Initial  contact  was  made  via 
automated  emails  generated  from  the  project  control  system. 
The  emails  linked  to  the  project  website  and  encouraged 
participants  to  log  on  and  complete  the  follow-up  assessment. 
If  there  was  no  response  to  the  original  notification  email,  the 
following  additional  notification  methods  were  used  on  a 
predetermined  schedule:  (1)  reminder  telephone  calls  by  site 
coordinators,  (2)  reminder  emails  from  the  automated  system, 

(3)  contacts  by  a  telephone  interviewer,  (4)  reminder  texts  from 
site  coordinators,  and  (5)  mailing  of  a  paper  and  pencil 
questionnaire. 

2.8.  Research  and  clinical  intervention  assessments 

This  trial  compares  two  interventions,  each  featuring 
measurement-based  care.  It  was  anticipated  that  administration 
rates  of  clinical  status  assessments  would  differ  across  the 
interventions  during  the  12-month  follow-up  period.  The 


differential  impact  of  STEPS-UP  versus  UCPC  was  assessed 
with  different  research  status  assessments  than  the  ones  STEPS- 
UP  and  UCPC  used  to  track  patients'  clinical  status.  This  was 
done  to  reduce  the  possibility  that  learning  effects  due  to 
differential  rates  of  repeated  clinical  assessment  administration 
across  study  arms  would  confound  research  trial  results,  In  the 
clinical  setting,  the  PCL-C  and  PHQ-9  were  used  to  track 
symptoms  over  time,  the  same  measures  used  to  determine 
intervention  eligibility  (as  described  earlier). 

The  following  measures  were  used  to  examine  primary 
outcomes  across  the  two  arms  of  the  trial: 

Posttraumatic  Diagnostic  Scale  (PDS).  The  PDS  is  a  self-report 
measure  that  assesses  both  severity  of  PTSD  symptoms 
related  to  a  single  identified  traumatic  event  and  probable 
diagnosis  of  PTSD  [50].  In  this  study,  the  first  section  of  the 
PDS  was  replaced  with  the  other  two  trauma  checklists  (see 
Table  2).  Respondents  were  asked  to  identify  the  trauma  that 
currently  bothering  them  the  most  and  the  frequency  of  17 
PTSD  symptoms  was  assessed.  The  PDS  shows  high  sensitiv¬ 
ity  (.89)  and  specificity  (.75)  as  compared  to  the  SCID-IV 
interview  for  PTSD,  with  a  high  degree  of  concordance  in 
diagnosis  (kappa  =  .65).  It  also  shows  high  internal 
consistency  (.92)  and  also  high  correlations  with  other 
related  constructs  and  test-retest  reliability  over  2-3  weeks 
(.78-84  for  each  symptom  cluster)  [51  j. 

Depression  Symptom  Severity:  Hopkins  Symptom  Checklist 
Depression  Scale-20  Item  Version  (HSCL-20).  The  HSCL-20 
is  a  self-report  scale  comprising  the  1 3  items  of  the  Hopkins 
Symptom  Checklist  Depression  Scale  plus  7  additional 
items  from  the  Hopkins  Symptom  Checklist-90-Revised. 
The  additional  7  items  were  added  to  better  represent  all 
diagnostic  symptoms  of  major  depression  and  improve  the 
instrument's  sensitivity  to  clinical  change  [52]. 

Several  other  secondary  outcomes  and  descriptive  variables 
were  assessed  as  described  in  Table  2.  In  addition  adminis¬ 
trative  data  on  service  utilization  were  obtained  for  cost 
analysis  and  qualitative  interviews  performed  to  understand 
the  process  of  care  (see  Sections  2.11  and  2.12  below). 

2.9.  Target  and  revised  sample  size 

Given  uncertainty  regarding  final  data  distributions,  the  a 
priori  approach  to  sample  size  calculation  was  conservative. 
Specifically,  the  sample  size  required  to  compare  12-month 
changes  in  the  outcomes  was  determined,  ignoring  the 
intervening  time  points  and  the  correlation  between  repeated 
measurements  on  the  same  subjects.  The  treatment  difference 
was  defined  to  be  D=  (X22—  X2i )  —  (X]2  —  Xu)  where  X,j  is 
mean  PDS  or  HSCL-20  score  in  treatment  arm  i  at  time  j  (j  =  0, 
12).  If  the  sample  size,  N,  and  standard  deviation,  a,  are  the 
same  in  both  treatment  arms  at  both  time  points,  then  the 
standard  error  of  D  is  2 cj/Vn. 

Dietrich  et  al.  [34]  and  Dobscha  et  al.  [61  ]  obtained  standard 
deviations  of  0.65-0.80  for  the  HSCL-20  at  the  various  time 
points  in  their  prospective  studies.  This  is  the  standard  deviation 
for  the  average  score  on  the  20  items  on  the  HSCL-20;  the 
corresponding  standard  deviations  for  the  sum  of  the  20  scores 
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Table  2 

List  of  research  assessment  constructs,  the  research  measures  used  to  assess  them,  and  research  measurement  time  points  at  which  they  were  assessed. 


Research  construct 

Research  measure(s) 

Time  points 

Demographics 

Adapted  versions  of  previously  tested  questions  to  assess  basic  demographics, 
military  and  deployment  history,  branch  of  service,  and  beneficiary  status 

BLa  only 

Military  traumatic 
stressors 

Deployment  Risk  and  Resilience  Inventory  [53]— Unit  Support  and  Post-Deployment  Life  Events  scales 

BL  only 

PTSD  criterion  a  trauma 
exposures 

DoD  Survey  of  Health  Related  Behaviors  Among  Active  Duty  Military  Personnel  Survey— Combat  Exposure 
Scale  [54] 

National  Comorbidity  Survey— Revised— PTSD  Traumatic  Events  Scale  [55] 

BL  only 

Social  support 

Medical  Outcomes  Study  Social  Support  Survey  Items  [56] 

BL  only 

Traumatic  brain  injury 
(TBI) 

TBI  items  from  Land  Combat  Study  [2] 

BL  only 

Primary  outcome 

PTSD  symptom  severity 

Posttraumatic  Diagnostic  Scale  (PDS)  [50] 

BL,  3-,  6-,  and 

12  months 

Depressive  symptoms 

HSCL-20  [52] 

BL,  3-,  6-,  and 

12  months 

Secondary  outcomes 

Somatic  symptoms 

PHQ-15  [57] 

BL,  3-,  6-,  and 

12  months 

Alcohol  abuse 

AUDIT-C  [47]  —  Bush  K,  Kivlahan  D,  McDonell  M,  Film  S,  Bradley  K.  The  AUDIT  alcohol  consumption  questions 
(AUDIT-C):  an  effective  brief  screening  test  for  problem  drinking.  Ambulatory  Care  Quality  Improvement 
Project  (ACQUIP).  Alcohol  Use  Disorders  Identification  Test.  Archives  Of  Internal  Medicine  [serial  online]. 
September  14, 1998;  158(1 6):  1789-1 795. 

BL,  3-,  6-,  and 

12  months 

Health-related 

functioning 

SF-12  [58] 

BL,  3-,  6-,  and 

12  months 

Work  presenteeism  and 
absenteeism 

WHO  Health  &  Work  Performance  Questionnaire  (HPQ)  Short  Form  [59] 

BL,  3-,  6-,  and 

12  months 

Pain 

Adapted  Numeric  Rating  Scale  for  Pain  [60] 

BL,  3-,  6-,  and 

12  months 

Health  service  use 

Adapted  versions  of  previously  used  questionnaires  to  assess  formal  and  informal  health 
service  use  frequency  and  type 

BL,  3-,  6-,  and 

12  months 

a  BL  =  baseline. 


were  13-16.  Assuming  that  the  item  variances  and  covariances 
for  the  HSCL-20  and  PDS  are  similar,  13-16  is  the  upper  limit  for 
the  standard  deviation  on  the  PDS;  i.e„  the  sum  of  17  items 
should  be  less  variable  than  the  sum  of  20  similar  items. 

With  2  endpoints  of  equal  interest,  a  Type  I  error  rate  of 
0.025  was  assumed  for  the  sample  size  calculations.  Using  this 
information,  a  target  sample  size  of  600  subjects  per  arm  was 
proposed,  inflating  this  to  750  per  arm  on  the  assumption  that 
20%  of  subjects  would  fail  to  provide  follow-up  data.  If  a  =  16, 
then  the  study  will  have  power  =  0.80  to  detect  a  difference  of 
D  =  5.7  between  average  12-month  changes  in  PDS  scores  in  the 
two  treatment  arms.  At  a  =  0.8,  power  =  0.80  is  anticipated  to 
detect  a  difference  of  D  =  0.29  on  the  HSCL-20. 

As  the  study  progressed  baseline  and  follow-up  data  were 
obtained,  allowing  a  re-examination  of  the  assumptions  under¬ 
lying  these  early  sample  size  calculations.  Interim  analysis 
indicated  that  the  standard  deviations  at  all  time  points  were 
substantially  less  than  those  used  in  the  original  calculations. 
It  was  also  found  that  the  correlation  between  repeated 
measurements  was  approximately  0.5.  Therefore,  the  sample 
size  required  to  have  power  =  0.80  to  detect  the  treatment 
differences  above  was  determined  to  be  substantially  less  than 
the  originally  planned  total  of  600  subjects  with  complete  data. 
A  sample  size  of  200  subjects  per  arm  with  complete  data 
would  provide  power  of  approximately  0.90  to  detect  the 
treatment  effects  described  above.  The  reduction  in  the  sample 
size  from  the  initial  target  was  due  to  our  ability  to  use  less 
conservative  assumptions  about  the  within-group  standard 
deviations  and  correlations. 


2.10.  Analysis  plan 

Two  approaches  to  data  analysis  are  under  consideration.  If  a 
parametric  model  can  be  identified  that  accurately  describes  the 
relationship  between  outcome  score  and  time  on  study,  then 
this  model  will  be  used  to  evaluate  the  treatment  effect.  If  such  a 
model  cannot  be  identified,  then  repeated  measures  analysis 
will  be  employed.  Under  the  repeated  measures  approach,  time 
is  treated  as  an  ordinal  categorical  variable.  Under  both 
approaches,  the  treatment  effect  is  evaluated  by  adding  an 
indicator  for  treatment  group  and  the  interaction  between 
treatment  group  and  time  to  the  model.  The  interaction 
provides  a  test  for  a  difference  between  rates  of  change  in 
outcome  score  in  the  two  treatment  arms.  If  the  interaction  is 
not  statistically  significant,  then  it  will  be  dropped  from  the 
model.  The  indicator  for  treatment  effect  will  then  provide  a 
test  for  differences  in  outcome  score,  averaged  over  time 
points,  between  treatment  arms.  Because  statistical  power  to 
detect  interactions  is  more  limited  than  power  to  detect  main 
effects,  this  step  may  identify  a  treatment  effect  that  is  missed 
in  the  first  part  of  the  analysis.  Because  the  two  outcomes,  PDS 
and  HSCL-20,  are  of  equal  interest,  a  critical  p-value  of  0.025 
will  be  used  to  evaluate  the  treatment  effect  for  each  one. 

The  effects  of  baseline  characteristics  on  treatment  re¬ 
sponses  will  be  evaluated  by  adding  these  characteristics  to  the 
model  in  secondary  analyses.  The  three-way  interaction  among 
time,  treatment  arm  and  a  baseline  trait  provides  a  test  for 
variation  in  the  treatment  effect  among  levels  of  the  baseline 
characteristic. 


316 


C.C.  Engel  etal.  /  Contemporary  Clinical  Trials  39  (2014)  310-319 


2.1 1.  Cost  analyses 

In  addition  to  assessing  the  impact  of  the  program  on 
patient  outcomes,  this  study  includes  cost-effectiveness  anal¬ 
ysis  (CEA)  completed  from  health  system  perspective.  CEA  is  a 
method  that  compares  the  economic  desirability  of  alternative 
health  interventions  by  calculating  the  marginal  cost  of  a  unit  of 
improved  health  [62,63].  Our  measure  of  cost-effectiveness  will 
be  the  incremental  cost-effectiveness  ratio  (ICER),  defined  as 
the  difference  in  the  per  capita  cost  of  the  treatment  and 
comparison  groups  divided  by  the  difference  in  the  average 
effectiveness  of  the  interventions.  Measurement  of  costs  will 
account  for  all  treatment  costs  (e.g.  medications,  nurse  and 
physician  salaries,  building  rents  and  maintenance,  equipment 
costs)  as  well  as  personal  costs  that  accrue  to  intervention 
participants.  At  each  wave  of  follow-up  research  assessment, 
automated  and  self-report  data  on  health  care  use  will  be  used 
to  understand  the  process  of  care,  including  number  and  type 
of  medical  and  mental  health  services,  telephone  care,  and  use 
of  Internet  resources.  Analyzing  these  data  will  allow  a  test  of 
whether  patients  randomized  to  STEPS-UP  care  will  have 
significantly  lower  direct  and  indirect  care  costs  and  more 
favorable  cost-effectiveness  ratio  compared  to  participants 
randomized  to  UCPC. 

2.32.  Qualitative  analyses 

To  assess  patient,  clinician,  and  care  manager  perceptions  of 
collaborative  care  interventions,  qualitative  interviews  were 
conducted  and  analyzed. 

To  assess  acceptability,  satisfaction,  and  effectiveness  of 
interventions  from  the  patient  perspective,  patients  were 
randomly  selected  from  the  enrolled  sample  so  as  to  include  6 
from  each  site— 3  from  STEPS-UP  and  3  from  UCPC.  They  were 
selected  early,  mid-way,  and  late  into  the  enrollment  period  at 
each  site  to  account  for  any  maturation  of  the  interventions 
within  site  over  time.  To  understand  experience  with  services 
over  time,  inteiviews  were  attempted  3  times  per  patient,  once 
after  enrollment,  3-months  later  and  6-months  later.  Specifically, 
patients  were  interviewed  about  their  satisfaction  with  their 
health  care,  the  various  seivices  offered  to  them  and  used, 
adherence  to  services,  any  barriers  or  challenges  to  receiving 
care,  and  their  recommendations  for  how  to  improve  the  system. 

To  understand  the  perceived  effectiveness  of  the  interven¬ 
tions  from  the  provider  perspective,  interviews  were  conducted 
mid-way  through  the  trial  with  5-7  randomly  selected  primary 
care  providers  from  each  site.  Interviews  included  their  views 
on  managing  PTSD  and  depression  in  primary  care,  their 
training  regarding  these  conditions,  challenges  within  their 
system,  and  their  direct  experience  with  the  two  inteiventions, 
including  facilitators  and  barriers  hours  spent  on  each  program, 
and  their  perceptions  of  patient  views  of  the  inteiventions. 

Finally,  each  site-located  and  centralized  care  manager  was 
inteiviewed  twice— once  early  in  implementation  and  a  second 
time  towards  the  end  of  the  study.  Interviews  focused  on  their 
perceptions  of  the  various  elements  of  the  STEPS-UP  interven¬ 
tion  (engaging  patients,  coordination  of  care,  use  of  telephone 
therapy  and  on-line  intervention  tools),  comfort  level  with  the 
role,  and  challenges  in  their  roles.  As  part  of  the  second 
inteiview,  chart-assisted  review  of  5  randomly  chosen  patients 
the  care  manager  had  followed  during  the  trial  was  discussed. 


The  focus  was  on  how  the  intervention  went  for  these  specific 
patients. 

3.  Results  (sample  characteristics) 

Fig.  1  displays  the  number  and  flow  of  potential  study 
participants  into  the  study.  Specific  reasons  for  ineligibility  or  not 
entering  the  study  are  noted.  Recruitment  was  conducted  at  six 
large  military  installations  located  nationwide.  At  the  end  of  the 
enrollment  period  (August  31,  2013),  UCPC  care  managers 
reported  receiving  2592  collaborative  care  referrals.  Of  those, 
1320  (51%)  gave  permission  for  research  team  contact,  had 
Internet  access,  and  anticipated  remaining  in  the  area  for  at  least 
six  months.  After  research  team  contact  for  informed  consent 
and  first  level  inclusion  screen,  1041  of  potential  participants 
remained  (40%  collaborative  care  referrals  across  the  six  sites). 
Of  the  60%  of  UCPC  referrals  (1551)  excluded  before  the 
eligibility  assessment,  922  (59%)  declined  research  participation 
and  355  (23%)  anticipated  moving  from  the  area  in  six  months 
or  less,  the  latter  figure  highlighting  the  mobility  of  the  active 
duty  population  and  a  major  challenge  to  providing  them  with 
sound  health  services. 

Of  the  1041  consenting  participants,  666  (64%)  met 
eligibility  criteria  and  were  enrolled  and  randomized,  332  to 
STEPS-UP  and  334  to  UCPC.  Among  the  375  (36%)  that  were 
excluded,  the  large  majority  (236,  63%)  did  not  meet  the  trial's 
inclusive  clinical  definition  for  either  PTSD  or  depression. 
Another  large  portion  (107,  29%)  were  essentially  too  severe, 
meeting  criteria  for  active  suicidal  ideation  or  alcohol  depen¬ 
dence.  Compared  to  those  randomized,  those  excluded  were 
similar  with  regard  to  gender  (18%  female  versus  19%;  p  =  0.78), 
younger  in  age  (30%  less  than  25  versus  22%;  p  =  0.03),  lower  in 
rank  (56%  junior  enlisted  versus  46%;  p  =  0.002),  and  less  likely 
to  have  deployed  (73%  versus  83%;  p  =  0.005).  Clinically, 
compared  to  those  randomized,  those  excluded  were  less  likely 
to  meet  study  diagnostic  criteria  for  PTSD  (40%  versus  90%; 
p  <  0.0001 ),  depression  (23%  versus  65%;  p  <  0.0001 ),  or  both 
(29%  versus  59%;  p  <  0.0001)  and  reported  higher  mean 
AUDIT-C  scores  (3.5  ±  2.9  versus  2.9  ±  2.4;  p  =  0.02). 

Table  3  presents  basic  information  about  the  socio¬ 
demographic  and  military  characteristics  of  the  study  partici¬ 
pants  along  with  data  for  selected  screening  and  baseline 
assessment  measures  for  the  overall  sample  and  for  those 
randomized  to  STEPS-UP  and  UCPC.  As  shown  and  expected, 
the  sociodemographic  and  military  characteristics  of  the 
participants  were  highly  similar  in  the  two  study  arms. 

Of  the  666  enrolled  in  the  study,  629  (94%)  screened 
positive  on  the  PC-PTSD  scale.  Those  629  were  then  asked  the 
PCL-C  items  and  90%  of  them  (n  =  566)  met  criteria  for  PTSD 
(1  or  more  items  were  met  for  Criterion  A,  3  or  more  for 
Criterion  B,  and  2  or  more  for  Criterion  C).  For  the  PHQ-9,  432 
(65%)  participants  met  criteria  for  depression.  Of  the  629 
participants  who  answered  both  the  PCL-C  and  the  PHQ-9, 370 
(59%)  met  criteria  for  both  PTSD  and  depression.  Participants  in 
the  STEPS-UP  arm  of  the  study  were  somewhat  more  likely  to 
meet  criteria  for  PTSD  and  depression  on  the  PCL-C  and  PHQ-9 
than  those  in  UCPC,  though  differences  were  not  statistically 
significant. 

Table  3  also  shows  average  scores  from  the  baseline 
assessment  for  three  outcome  measures:  (a)  PTSD  measured 
by  the  PDS  scale,  (b)  depression  measured  by  the  Hopkins 
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Fig.  1.  CONSORT  flow  diagram  for  STEPS-UP  Trial  through  the  baseline  assessment. 

Symptom  Checklist  (HSCL-20),  and  (c)  severity  of  somatic  had  moderate  to  severe  levels  of  PTSD.  For  the  Hopkins 

symptoms  measured  by  the  PHQ-15  [50,52,57].  For  the  PDS,  Symptom  Checklist  (HSCL-20),  average  baseline  scores  were 

the  mean  score  of  29.2  indicated  that  on  average  participants  2.1  out  of  a  possible  4.0  suggesting  that  participants  had 


Table  3 

Characteristics,  screening,  and  assessment  measures  of  STEPS-UP  participants .* 


Characteristic 

Total 

STEPS-UP 

UCPC 

P 

N  =  666 

N  =  332 

N  =  334 

n  (%)  or  mean  (SD) 

n  (%)  or  mean  (SD) 

n  (%)  or  mean  (SD) 

Gender 

Female 

127 (19%) 

68 (20%) 

59  (18%) 

0.35 

Age 

18-24 

138 (22%) 

73  (24%) 

65 (21%) 

0.74 

25-34 

272  (44%) 

135  (44%) 

137  (45%) 

>35 

205  (33%) 

100 (32%) 

105 (34%) 

Rank 

E1-E4 

306 (46%) 

151  (46%) 

155 (47%) 

0.091 

E5-E6 

274  (41%) 

146 (44%) 

128  (39%) 

E7-05 

81  (12%) 

32 (10%) 

49  (15%) 

Installation 

A 

126 (19%) 

63  (19%) 

63  (19%) 

>0.99 

B 

26  (4%) 

13  (4%) 

13  (4%) 

C 

200 (30%) 

100 (30%) 

100 (30%) 

D 

18  (3  %) 

9(3  %) 

9(3%) 

E 

250  (38%) 

124  (37%) 

126 (38%) 

F 

46  (7  %) 

23  (7  %) 

23  (7%) 

Marital  status 

Married 

446  (67%) 

222  (67%) 

224  (67%) 

>0.99 

Education 

High  school 

203 (30%) 

99 (30%) 

104  (31%) 

0.51 

Some  college 

325  (49%) 

169(51%) 

156  (47%) 

College  degree 

138 (21%) 

64  (19%) 

74  (22%) 

Race/ethnicity 

White 

318 (48%) 

158 (48%) 

160(48%) 

0.97 

Black 

160 (24%) 

82  (25%) 

78  (23%) 

Hispanic 

117 (18%) 

57 (17%) 

60(18%) 

Other 

70  (11%) 

34(10%) 

36(11%) 

Clinical  indicators 

PC-PTSD 

>2 

629  (94%) 

310(93%) 

319  (96%) 

0.23 

PCL-C 

DSM-IV 

566  (90%) 

285 (86%) 

281 (84%) 

0.54 

PHQ-9 

DSM-1V 

432  (65%) 

224  (67%) 

208  (62%) 

0.16 

PTSD  and  depression 

+  PCL-C  and  PHQ-9 

370  (59%) 

193  (62%) 

177 (55%) 

0.18 

AUDIT-C 

score 

2.8  (2.4) 

3.0  (2.5) 

2.7  (2.3) 

0.15 

Deployments  after  2001 

0 

114 (17%) 

59(18%) 

55 (16%) 

0.89 

1 

209  (31%) 

102 (31%) 

107 (32%) 

2 

159 (24%) 

82  (25%) 

77 (23%) 

>3 

184 (28%) 

89  (27%) 

95 (28%) 

Research  assessments 

PDS 

Range,  0-51 

29.2  (9.2) 

29.4  (9.4) 

28.9  (8.9) 

0.55 

HSCL-20  (range,  0-4) 

Range,  0-4 

2.1  (0.6) 

2.1  (0.6) 

2.0  (0.7) 

0.0094 

PHQ-15  (range,  0-30) 

Range,  0-30 

13.7  (4.8) 

14.1  (4.7) 

13.4(4.8) 

0.086 

High  combat  exposure 

CES  score  >10 

452  (68%) 

224  (67%) 

228  (68%) 

0.83 

*  Table  includes  completed  data  only.  Missing  items  were  rare,  but  result  here  in  missing  observations.  Missing  data  imputation  and  intent-to  treat  analyses  are 
planned  for  longitudinal  data  analyses. 
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moderate  levels  of  depression.  For  the  PHQ-15,  the  average 
score  of  13.7  indicates  medium  somatic  symptom  severity. 

4.  Discussion 

The  STEPS-UP  Trial  is  the  first  randomized  effectiveness  trial 
of  mental  health  services  conducted  in  the  US  Military  Health 
System  and  represents  a  potentially  important  shift  in  the  way 
new  clinical  programs  are  developed,  tested  and  implemented 
for  its  9  million  beneficiaries  to  include  military  members, 
retirees,  and  their  families.  The  design  and  baseline  sample  from 
this  6  installation  randomized  effectiveness  trial  was  described, 
comparing  the  impact  of  collaborative  care  implementation  on 
PTSD  and  depression  outcomes  across  18  military  health  system 
clinics. 

A  total  of  666  participants  were  assigned  to  one  of  two  arms 
and  followed  for  12  months.  The  comparison  group  received 
“usual  collaborative  primary  care"  as  it  has  been  widely 
practiced  in  US  Army  clinics  since  2007,  collaborative  care  in 
which  implementation  is  managed  largely  at  the  installation 
level.  STEPS-UP  intervention  participants  received  collaborative 
care  using  a  centrally  managed  implementation  process.  STEPS- 
UP  included  central  oversight  of  care  managers  trained  in  patient 
engagement  techniques,  availability  of  remote  care  managers  for 
service  members  in  transition,  and  stepped  provision  of  both 
psychotherapeutic  (web-based  CBT  self-management,  tele¬ 
phone  CBT  from  a  central  psychologist,  and  site-based  face-to- 
face  options)  and  pharmacologic  treatment  options.  Of  note,  the 
most  common  reason  for  exclusion  besides  declining  to 
participate  in  research  was  the  expectation  of  relocating  from 
the  site  within  six  months.  The  geographic  mobility  of  military 
members  with  mental  health  needs  underlines  the  important 
need  to  implement  military  health  system  strategies  that 
enhance  patient  engagement  and  deliver  safe  and  confidential 
services  to  remote  and  highly  mobile  patients. 

The  STEPS-UP  Trial  may  eventually  serve  as  a  model  for 
future  scientific  assessments  of  system  change  on  clinical 
outcomes  in  military  and  veteran  service  systems.  Key  by¬ 
products  of  the  trial  for  posterity  will  be  program  manuals 
(primary  care,  mental  health  specialist,  care  manager,  phone 
therapy,  and  central  program  monitoring  and  operations),  a 
web-based  clinical  decision  support  tool,  patient  education  tools, 
and  other  tools  that  will  enhance  the  scalability  of  the 
intervention.  If  the  STEPS-UP  intervention  proves  effective, 
these  tools  may  play  an  instrumental  future  role,  given  the 
virtual  certainty  that  large  numbers  of  the  U.S.  military  will  once 
again  step  into  harm's  way. 
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Abstract. 


Objective:  To  determine  the  effectiveness  of  centrally  assisted  collaborative  telecare  (CACT)  for 
PTSD  and  depression  in  military  personnel  attending  primary  care. 

Methods:  STEPS-UP  (STepped  Enhancement  of  PTSD  Services  Using  Primary  care)  is  a 
randomized  trial  comparing  CACT  to  usual  integrated  mental  health  care  for  PTSD  or 
depression.  Patients  were  enrolled  from  18  primary  care  clinics  at  six  US  sites  from  February 
2012  to  August  2013  with  follow-up  at  three,  six,  and  12-months.  Patients  were  randomly 
assigned  (computer  automated,  within  site)  to  CACT  (n  =  332)  or  usual  care  (n  =  334).  CACT 
patients  received  12  months  of  stepped  psychosocial  and  pharmacologic  treatment  with  nurse 
telecare  management  of  caseloads,  symptoms,  and  treatment.  Primary  outcomes  were  severity 
scores  on  the  PTSD  Diagnostic  Scale  (PDS;  scored  0-51)  and  Symptom  Checklist  depression 
items  (SCL-20;  scored  0-4). 

Results:  CACT  and  usual  care  patients  had  similar  baseline  PDS  PTSD  (29.4±9.4  vs.  28.9  ±8.9) 
and  SCL-20  depression  scores  (2.1  ±0.6  vs.  2.0±0.7).  CACT  patients  reported  a  greater  12- 
month  decrease  in  PDS  PTSD  (-2.53;  95%  CI=0.59-4.47)  and  in  SCL-20  depression  scores 
(-0.26;  95%  Cl=0.1 1-0.41).  There  were  no  study-related  serious  adverse  events  (emergency 
visits,  hospitalizations  or  deaths)  in  either  treatment  group. 

Conclusions:  Central  assistance  for  collaborative  telecare  including  stepped  psychosocial  and 
pharmacologic  management  improves  outcomes  of  PTSD  and  depression  among  military 
personnel  and  may  offer  an  effective  model  of  care  for  other  PTSD  populations. 

Clinical  Trials  Registration  Name:  “Stepped  Enhancement  of  PTSD  Services  Using  Primary 
Care  (STEPS  UP):  A  Randomized  Effectiveness  Trial” 

Number:  NCT01 492348 

URL:  https://clinicaltrials.gov/ct2/show/NCT01492348 


introduction 


A  recent  Institute  of  Medicine  report  emphasized  an  urgent  need  for  the  U.S. 
Departments  of  Defense  (DoD)  and  Veterans  Affairs  (VA)  to  expand  their  capacity  for 
integrated,  coordinated,  and  evidence-based  PTSD  care  (1).  The  prevalence  of  post¬ 
deployment  PTSD  and  depression  in  the  U.S.  military  is  estimated  at  1 3%— 1 8%,  and  28% 
report  severe  symptoms  of  PTSD,  anxiety,  or  depression  (2,  3).  These  problems  cause  suffering 
and  impairment  and  contribute  to  military  attrition,  absenteeism,  misconduct,  and  sick  call  visits 
(4-6).  Fewer  than  half  of  affected  serving  military  personnel  receive  military  mental  health 
services  and  many  accessing  services  do  not  receive  adequate  care  (2,  3,  5).  While  there  is 
variation  across  Western  nations  in  the  magnitude  of  these  problems  (7)  and  in  the  ways  that 
care  is  provided,  mental  health  services  for  military  personnel  are  an  international  priority. 

Collaborative  care  is  an  increasingly  evidence-based  method  of  extending  the  reach, 
quality  and  outcomes  of  care  for  common  mental  disorders  in  medical  settings  (8,  9). 
Randomized  trials  of  collaborative  care  have  demonstrated  improved  outcomes  among  patients 
with  depression  and  anxiety  (9-11),  depression  related  suicidal  ideation  (12,  13),  depression 
and  chronic  health  conditions  (e.g.,  diabetes,  asthma,  14),  and  chronic  pain  (15,  16).  For  PTSD 
specifically,  however,  there  have  been  only  two  randomized  trials  of  collaborative  care,  one 
demonstrating  improvements  in  PTSD  (17)  while  the  other  did  not  (18).  Thus,  there  is  a  need  for 
additional  work  in  the  development  and  study  of  collaborative  care  models  for  PTSD. 

Recent  U.S.  military  efforts  to  address  mental  health  services  have  sought  to  better 
integrate  them  into  primary  care,  with  the  first  U.S.  Army  integration  approach  beginning  in  2007 
(19,  20).  Despite  the  implications  for  current  and  future  wartime  health  care,  no  controlled  trials 
investigating  these  integration  efforts  have  been  completed.  In  the  meantime,  access  to  and 
quality  of  mental  health  services  for  military  personnel  has  been  a  recurring  public  policy 
concern  (1,21).  We  now  report  the  results  of  a  large  multisite  randomized  trial  of  centrally 
assisted  collaborative  telecare  (CACT)  for  PTSD  and  depression  among  military  personnel 
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attending  primary  care.  The  STEPS-UP  trial  (STepped  Enhancement  of  PTSD  Services  Using 
Primary  Care)  compares  CACT  to  the  U.S.  Army’s  preexisting  program  that  integrates 
behavioral  health  into  primary  care. 

Methods 

Design 

The  study  design  is  published  elsewhere  in  detail  (22).  The  study  was  reviewed  and 
approved  by  institutional  research  review  boards  at  Walter  Reed  National  Military  Medical 
Center  (primary),  six  participating  Army  installations  (i.e. ,  military  base/post,  each  of  which  may 
hosted  multiple  participating  clinics),  RTI  International,  RAND  Corporation,  University  of 
Washington,  and  Boston  VA,  and  the  Human  Research  Protection  Office,  U.S.  Army  Medical 
Research  Command.  All  participants  provided  written  informed  consent. 

Briefly,  a  two  parallel  arm  randomized  design  was  used  to  evaluate  the  effectiveness  of 
a  12-month  primary  care  treatment  program  for  military  personnel  with  PTSD  and/or  depression. 
An  effectiveness  design  was  chosen  to  enhance  the  external  validity  of  the  findings  (22).  The 
primary  hypothesis  was  that  CACT  delivered  with  stepped  psychosocial  and  pharmacologic 
management  would  be  superior  to  usual  integrated  mental  health  care  (defined  immediately 
below)  for  improving  PTSD  and  depression  in  primary  care. 

Intervention 

Usual  Care.  In  2007  Army  primary  care  clinics  began  using  an  integrated  mental  health 
approach  called  RESPECT-Mil  (20,  23)  based  on  a  “three  component  model”  (24,  25).  This 
program  constituted  usual  care  for  trial  participants.  In  this  model,  efforts  to  improve  primary 
care  for  PTSD  and  depression  (1)  equip  and  train  clinics  to  screen  each  visit  and  use  symptom 
severity  tools  for  diagnosis  and  assessment;  (2)  use  nurse  care  managers  to  contact  patients 
monthly  and  provide  symptom  status  to  primary  care  clinicians;  and  (3)  increase  access  to  a 
non-primary  care  clinic  based  mental  health  specialist.  All  18  participating  primary  care  clinics  at 
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six  Army  installations  (and  97  worldwide  clinics  at  39  Army  installations)  practiced  this  model.  A 
detailed  comparison  of  usual  care  and  CACT  components  is  published  elsewhere  (22). 

Centrally  Assisted  Collaborative  Telecare  (CACT).  PTSD  treatment,  relative  to  the 
treatment  of  major  depression,  panic  disorder  or  generalized  anxiety  disorder  alone,  is  complex: 
(1)  pharmacotherapies  are  useful  for  PTSD  comorbidities  but  relatively  ineffective  for  PTSD  per 
se  and  (2)  involves  greater  emphasis  on  the  delivery  of  psychosocial  interventions,  particularly 
those  involving  trauma  and  non-trauma  focused  cognitive  behavioral  therapies  (CBT).  CACT 
was  therefore  developed  to  better  assist  busy  primary  care  settings  with  the  delivery  of  CBT- 
related  and  other  psychosocial  support  strategies.  CACT  added  to  usual  care  in  four  ways:  (1) 
care  management  enhancements;  (2)  stepped  psychosocial  treatment  options  (web,  phone,  in 
person);  (3)  electronic  symptom  registry  for  measurement-based  treatment  planning  (symptoms 
are  measured  at  regular  intervals  and  care  is  intensified  for  patients  with  recurrent  or  persistent 
PTSD  and/or  depression)  and  for  telecare  manager  caseload  and  site  performance  monitoring; 
and  (4)  routine  assisted  review  of  patient,  telecare  manager,  and  site  performance  by  a  central 
psychiatrist  and  psychologist. 

Care  Management  Enhancements:  Care  managers  were  nurses  trained  in  behavioral 
activation,  problem  solving,  and  motivational  interviewing  to  enhance  patient  engagement,  to 
assist  treatment  planning,  and  to  offer  patients  basic  psychosocial  support.  Care  managers 
contacted  patients  by  phone  and  encouraged  patients  to  adhere  to  treatment  and  remain  in 
care. 

Stepped  Psychosocial  Treatment  Options:  In  addition  to  supportive  assistance  from  the 
care  manager,  CACT  participants  had  access  to  online  cognitive  behavioral  self-management 
(26,  27),  telephonic  cognitive  behavioral  therapy  using  a  modularized,  flexible  protocol  offered 
with  a  central  team  psychologist  (28),  and  face-to-face  psychotherapy  with  a  specialist  in  either 
a  primary  care  site  or  specialty  care  clinic.  Stepped  pharmacologic  treatments  were  available  in 
CACT  and  usual  care. 
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Electronic  Symptom  Registry:  An  electronic  symptom  registry  tracked  PTSD  and 
depression  symptoms,  identified  patients  in  need  of  central  specialist  review  (less  than  5  point 
change  in  the  previous  8  weeks  on  clinical  severity  indicators  [PCL  for  PTSD,  PHQ-9  for 
depression]  or  PCL  >30  or  PHQ-9  >10)  to  recommend  treatment  change,  and  provided 
aggregate  site-  and  program-level  data  for  performance  monitoring  (29,  30).  The  electronic 
symptom  registry  helps  guide  care  managers  through  each  patient  contact  and  insures 
appropriate  questions  are  asked  and  areas  assessed.  Clinical  data  entered  during  telecare 
contacts  included  depression  (PHQ-9)  (31)  and  PTSD  severity  (PTSD  Checklist,  Civilian 
Version;  PCL-C)  (32). 

Central  Assistance  and  Review:  Central  specialist  consultation,  caseload  review,  and 
patient  review  were  performed  in  CACT.  The  central  team  included  a  psychiatrist,  psychologist, 
and  nurse  care  manager.  The  team  assisted  care  by  (1)  monitoring  patient  data  and  using  the 
electronic  record  to  recommend  when  primary  care  providers  should  increase  patients’ 
treatment  intensity  (psychosocial  or  pharmacologic);  (2)  reviewing  care  manager  caseloads  and 
discussing  their  patients;  and  (3)  identifying,  assessing  and  addressing  emerging  installation 
barriers  to  specialty  care. 

Participants  and  Data  Collection 

Six  hundred  sixty-six  patients  were  randomized  from  February  2012  through  September 
2013  at  18  troop  medical  clinics  located  at  six  large  Army  installations  in  the  continental  U.S. 
Interested  service  members  were  referred  by  their  primary  care  clinician  to  nurse  care 
managers  and  then  contacted  by  a  study  research  assistant  to  assess  eligibility  and  obtain 
informed  consent.  Eligible  patients  (a)  were  serving  on  active  duty  at  enrollment;  (b)  met  DSM- 
IV-TR  criteria  for  probable  PTSD  on  the  PTSD  Checklist-Civilian  Version  (PCL-C)  or  probable 
depression  on  the  Patient  Health  Questionnaire-9,  or  both;  and  (c)  reported  having  Internet  and 
e-mail  access.  Study  assessments  were  web-based  with  participant  entry  (in  a  few  cases  by 
phone  interviewers  or  paper  and  pencil  questionnaire). 
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Potential  participants  were  excluded  for  (a)  recent  participation  in  usual  care 
management;  (b)  current  alcohol  dependence  (Alcohol  Use  Disorders  Identification  Test, 
AUDIT>15)  (33);  (c)  active  suicidal  ideation  in  the  prior  two  months  (Mini  International 
Neuropsychiatric  Interview  (MINI)-Plus  Suicidality  Module  score  >9)  (34);  (d)  expected 
permanent  geographic  relocation  over  the  next  six  months  (e.g.,  change  of  station,  deployment, 
demobilization,  separation);  or  (e)  current  duties  in  a  participating  clinic. 

Randomization 

After  completing  the  baseline  assessment,  participants  were  randomized  to  CACT  or 
usual  care.  This  was  accomplished  centrally  in  real  time  using  a  computer-automated  system 
with  results  delivered  direct  to  patients  and  care  managers.  Randomization  was  stratified  by 
clinic  and  automated  emails  were  used  to  initiate  follow-up  research  assessments.  In  the 
absence  of  response  to  initial  emails,  additional  methods  were  used  on  a  predetermined 
schedule:  (a)  reminder  telephone  calls,  (b)  reminder  emails,  (c)  telephone  interviewer  contacts, 
(d)  reminder  texts,  and  (e)  paper  questionnaire  mailing.  Patients  provided  research 
assessments  using  a  direct  entry  computer  interface  at  baseline,  three,  six,  and  12  months. 
Outcomes 

Primary.  Primary  outcomes  were  the  Posttraumatic  Diagnostic  Scale  (PDS)  (35,  36)  for 
PTSD  symptoms  and  the  Symptom  Checklist  Depression  Scale  (SCL-20)  for  depressive 
symptoms  (37).  PDS  (17  items)  assesses  severity  of  PTSD  symptoms  over  the  prior  four  weeks 
with  high  internal  consistency  and  test-retest  reliability  (36);  scores  are  summed  and  range  from 
0  to  51;  scores  <.  10  are  considered  mild,  ^>11  and  <  20  moderate,  ^21  and  <  35 
moderate  to  severe,  and  .>36  severe.  SCL-20  is  comprised  of  13  Hopkins  Symptom 
Checklist  Depression  Scale  items  plus  seven  additional  depression  items  from  the  Symptom 
Checklist-90-Revised.  The  latter  items  better  covered  all  diagnostic  symptoms  of  depression 
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and  improve  sensitivity  to  clinical  change.  Scores  are  a  mean  of  item  scores  and  range  from  0 
to  3  (37). 

Secondary.  Secondary  outcomes  were  suicidality,  somatic  symptoms,  pain  intensity  and 
interference,  alcohol  misuse,  and  physical  and  mental  health  related  quality  of  life.  Suicidality 
was  assessed  with  three  items  from  the  SCL-20  (37)  that  measured  hopelessness,  thoughts 
about  death,  and  thoughts  about  suicide.  Physical  symptom  severity  was  assessed  with  the 
PHQ-15,  a  15-item  scale  with  scores  ranging  from  0  to  30  (38).  Health  related  quality  of  life  was 
assessed  with  the  Short  Form  -  12  (SF-12)  (39),  with  two  subscales  measuring  physical  health 
and  mental  health  related  functioning.  Each  subscale  is  normed  against  the  general  population 
such  that  mean  and  standard  deviation  are  approximately  50  and  10  respectively  (40).  Pain 
intensity  and  interference  were  assessed  with  the  Adapted  Numeric  Rating  Scale  for  Pain  (41); 
each  item  is  rated  on  a  0  tolO  Likert  scale.  Alcohol  outcomes  were  measured  using  the  AUDIT 
Alcohol  Consumption  Questions  (AUDIT-C),  three  items  that  sum  to  scores  of  0  to  12  (42). 
Patients  reported  amount  and  type  of  health  care  and  medication  use  at  each  assessment. 
Counts  of  key  intervention  components  were  derived:  number  of  individual  patient  visits  with  a 
mental  health  specialist  and  number  of  telephone  contacts  with  a  health  care  provider  such  as  a 
care  manager  or  other  telephone  assistance  (e.g.,  crisis  or  helpline).  Psychoactive  medications 
were  coded  for  type  and  duration,  and  used  to  derive  a  count  of  months  on  a  guideline 
concordant  depression  medication  (i.e.,  antidepressant)  or  PTSD  medication  (i.e.,  SSRI, 
prazosin). 

Safety  and  Adverse  Events.  Serious  adverse  events  were  defined  as  participant  death 
from  any  cause;  or  psychiatric  emergency  or  hospitalization  related  to  study  participation.  The 
study  data  and  safety  monitoring  board  (DSMB)  chair  and  the  site-specific  independent  study 
monitor  reviewed  and  collated  all  reported  adverse  event  reports  to  insure  safe  study 
implementation. 
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Statistical  analyses 


For  the  sample  size  calculations,  we  focused  on  the  effect  size,  Mj,  for  12-month 
changes  in  scores  in  the  two  treatment  groups,  where  A  is  the  expected  value  of  the  difference 
between  mean  12-month  changes  and  a  is  the  within-group  standard  deviation  at  each  time 
point.  Initially,  we  assumed,  conservatively,  zero  correlation  between  repeated  measurements 
on  the  same  subject  reflecting  that  a  study  with  600  subjects  per  arm  and  a  Type  I  error  rate  of 
0.025  to  account  for  two  endpoints  of  interest  would  have  power=0.80  to  detect  an  effect  size  of 
A/a=0.252.  Previous  studies  have  reported  similar  effect  sizes  (36,  43).  The  sample  size  was 
inflated  to  750  subjects  per  group  to  account  for  an  anticipated  attrition  rate  of  20%.  We 
reevaluated  the  sample  size  calculations  after  129  subjects  had  completed  12-month 
assessments.  Correlations  between  repeated  measurements  were  nearly  all  >0.50.  A 
correlation  of  0.50  reduced  the  required  sample  size  for  the  same  power  and  effect  size  to  300 
subjects  per  treatment  group. 

Analysis  of  scores  on  the  PDS  and  SCL-20  was  based  on  an  exponential  model  of  score 
vs  time:  sijk  =  Pjx  +  bjj  +  Pj2e_(5i3tiik  +  dijk  where  sjjk  is  score  (PDS  or  SCL-20)  for  subject  i  in 
treatment  arm  j  (j=1,2)  at  assessment  k  (k=1,..,4),  (3^,  pj2  and  pj3  are  fixed  parameters,  b^  is  a 
normally  distributed  random  parameter  with  mean  zero,  tijk  is  time  on  study  at  assessment  k 
and  dijk  is  a  normally  distributed  error  term  with  mean  zero.  This  model  accurately  described 
changes  both  in  mean  scores  and  the  variance  of  scores  at  each  assessment.  Under  this 
model,  A=  (pi2e_12(513  -  p12)  -  (P22e_12(523  -  P22)-  Under  the  null  hypothesis  that  A=0,  A/SE(A) 
has  approximately  a  standard  normal  distribution. 

To  determine  whether  responses  were  clinical  significant,  we  compared  the  proportions 
of  subjects  achieving  at  least  a  50%  reduction  in  a  score  at  the  three  follow-up  time  points, 
using  a  generalized  linear  model  with  GEE  invoked  to  account  for  correlations  between 
repeated  observations  on  the  same  subjects. 
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Changes  in  the  secondary  endpoints  were  compared  using  repeated  measures  linear 
models  because  the  exponential  model  did  not  fit  the  data.  Predictors  included  treatment  group, 
time  and  the  interaction  of  time  and  group,  with  the  interaction  included  to  provide  a  test  for 
differences  between  trends  over  time  in  the  two  groups.  Changes  in  health  care  use  were 
compared  using  Poisson  regression  with  GEE.  Baseline  use  was  treated  as  a  covariate.  Other 
predictors  included  treatment  group,  an  ordinal  categorical  variable  for  time  and  their  interaction. 

For  scores  on  the  PDS  and  SCL-20,  we  tested  for  differences  between  changes  in  the 
two  treatment  arms  over  the  first  three  months  and  the  first  6  months  to  determine  whether 
differences  that  were  identified  over  12  months  were  apparent  earlier.  We  repeated  this  for  the 
proportion  with  at  least  a  50%  reduction  in  score.  We  did  not  perform  these  additional  tests  for 
the  secondary  endpoints  or  health  care  use,  so  we  only  report  the  overall  p-values  for 
comparing  treatment  arms  for  these  outcomes. 

The  main  analysis  was  done  at  the  end  of  the  trial  and  included  all  randomized 
participants  with  usable  outcome  data  according  to  the  intention-to-treat  principle.  The  number 
needed  to  treat  for  a  binary  outcome  was  one  divided  by  the  absolute  difference  between 
groups.  Data  analyses  were  conducted  using  SAS/STAT  software  Version  9.3  of  the  SAS 
System  for  Windows. 

Results 

Sample 

Figure  1  presents  the  study  flow  diagram.  Follow-up  rates  were  high  with  assessments 
completed  by  93%  of  patients  at  three  months,  90%  at  six  months,  and  86%  at  12  months.  Of 
the  666  randomized  patients,  332  were  assigned  to  CACT  and  334  to  usual  care.  Complete 
follow-up  data  were  obtained  for  273  (82.2%)  CACT  and  280  (83.8%)  usual  care  participants. 
There  was  only  baseline  data  for  9  (2.7%)  CACT  participants  and  21  (6.3%)  usual  care 
participants.  CACT  and  usual  care  groups  were  balanced  on  baseline  characteristics  (Table  1). 
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Mean  PDS  PTSD  score  was  29.2  indicating  moderate  to  severe  PTSD  and  mean  SCL-20 
depression  score  was  2.1,  indicating  moderate  depression  severity. 

PTSD  and  Depression  Outcomes 

Compared  with  usual  care,  patients  in  CACT  reported  significantly  greater  reductions  in 
PTSD  and  depression  symptoms  over  12-months  of  follow-up  (Table  2).  Differences  in  effects 
were  statistically  significant  at  12-months  for  PTSD  and  at  six  and  12  months  for  depression. 
Reductions  were  clinically  significant  for  both  PTSD  and  depression,  with  significantly  more 
CACT  patients  achieving  at  least  a  50%  reduction  in  symptoms.  At  12-month  follow-up, 
numbers  needed  to  treat  were  12.5  (95%  Cl,  6.9-71.9)  for  PTSD  and  11.1  (95%  Cl,  6.2-50.5)  for 
depression. 

Secondary  Health  Outcomes 

Significant  improvements  in  CACT  versus  usual  care  groups  were  noted  for  physical 
symptoms  (PHQ-15)  and  mental  health  functioning  (SF-12  mental  component).  Significant 
differences  between  intervention  and  control  were  not  found  for  alcohol  consumption  (AUDIT- 
C),  physical  health  function  (SF-12  physical  component)  or  pain  (intensity  and  interference; 
Table  3).  Of  note,  repeated  measures  analysis  (treatment  group,  by  time,  and  their  interaction) 
revealed  statistically  significant  reductions  in  suicide-related  SCL-20  items  in  the  CACT  arm 
(versus  no  change  in  usual  care)  for  “hopelessness  about  the  future”  (p=0.04),  “thoughts  of 
death  and  dying”  (p=0.003),  and  in  “thoughts  of  ending  one’s  life  (p=0.04). 

Process  of  Care 

We  examined  four  key  aspects  of  the  process  of  care  expected  to  differ  between  the 
CACT  and  optimized  usual  care  arms:  individual  psychotherapy,  telephone  contacts  with  the 
care  manager,  and  use  of  appropriate  PTSD  or  depression  medications  (Table  4).  No  treatment 
by  time  interactions  were  detected  on  these  measures,  but  CACT  participants  reported 
significantly  more  telephone  contacts  and  more  months  on  an  appropriate  PTSD  and 
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depression  medication.  No  differences  were  detected  on  the  number  of  individual  visits  with  a 
mental  health  specialist. 

Adverse  Events 

There  were  no  participant  deaths  and  no  psychiatric  emergencies  or  hospitalizations 
determined  to  be  study  related. 

Discussion 

This  is  the  first  randomized  trial  to  assess  the  impact  of  a  collaborative  care  approach  for 
serving  military  personnel,  and  one  of  the  few  primary  care  trials  to  examine  a  collaborative  care 
model  for  PTSD.  Military  personnel  attending  primary  care  with  PTSD  or  depression  who  were 
referred  to  12  months  of  centrally  assisted  telecare  with  stepped  psychosocial  and 
pharmacologic  management  (CACT)  reported  significant  improvements  in  PTSD  and 
depression  severity,  physical  symptom  severity,  and  mental  health  function  compared  to  those 
referred  to  usual  integrated  mental  health  care  in  primary  care.  Differences  were  clinically 
significant,  with  numbers  needed  to  treat  for  50%  improvement  of  PTSD  and  depression  of  12.5 
and  11.1  respectively.  The  effects  were  somewhat  smaller  than  those  often  observed  in 
collaborative  care  trials  for  depression  and  anxiety  (9),  perhaps  due  to  the  fact  that  usual  care, 
while  largely  untested,  was  a  long-standing  program  of  mental  health  integration  that  included 
nurse  care  management  (20).  The  effects  on  PTSD  were  similar  in  size  to  those  for  depression, 
though  a  statistically  significant  PTSD  response  occurred  later  than  for  depression.  Telephone 
contacts  were  greater  in  CACT  than  in  usual  care,  but  corresponding  increases  in  evidence- 
based  medication  and  psychotherapy  use  appeared  relatively  small.  Greater  implementation  of 
active  treatments  may  result  in  larger  symptom  improvements. 

There  are  other  potential  explanations  for  the  size  of  the  observed  intervention  effect. 
First,  to  maximize  the  generalizability  of  study  findings,  we  included  patients  undergoing  medical 
retirement  or  administrative  military  separation  at  time  of  randomization,  and  these  severely  ill 
patients  constituted  14%  of  the  study  sample.  Second,  military  personnel,  especially  in  time  of 
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war,  are  a  highly  mobile  group.  Many  left  the  military  over  the  course  of  their  follow-up,  and 
helping  them  to  remain  engaged  in  treatment  during  this  transition  was  difficult.  Additionally, 
unlike  most  previous  studies  involving  collaborative  care,  our  trial  participants  were  mainly 
young  men  in  their  twenties,  a  demographic  group  that  is  among  the  least  likely  to  attend  mental 
health  treatment.  In  this  group,  confidentiality  concerns  may  further  erode  willingness  to  attend 
or  remain  engaged  in  mental  health  care.  While  service  members  were  often  willing  to  discuss 
problems  with  a  nurse  care  manager,  many  expressed  concerns  about  seeing  a  mental  health 
specialist.  Third,  even  though  participating  primary  care  clinics  were  staffed  with  mental  health 
specialists,  obtaining  evidence-based  psychotherapy  was  difficult.  Finally,  the  usual  care 
intervention  featured  a  potentially  active  form  of  integrated  care  employed  across  the  health 
system  at  the  time  of  the  study  and  therefore  this  study  is  likely  to  offer  a  conservative  estimate 
of  intervention  benefit. 

Longer  time  to  significant  improvement  for  PTSD  as  compared  to  depression  is  perhaps 
a  function  of  the  greater  complexity  and  comorbidity  associated  with  PTSD,  the  lower  efficacy  of 
pharmacologic  PTSD  treatments  (44,  45),  and  the  fact  that  many  primary  care  clinicians 
considered  PTSD  to  be  outside  their  scope  of  clinical  comfort  (20).  We  did  not  observe 
significant  improvements  in  alcohol  misuse  or  in  pain  outcomes  per  se;  however  we  observed 
significant  improvements  in  mental  health  related  function  and  overall  physical  symptom 
severity,  suggesting  intervention  impact  went  beyond  the  targeted  disorders.  Of  note,  CACT 
was  associated  with  reductions  in  suicidal  ideation,  preliminary  findings  consistent  with  a 
previous  randomized  trial  of  collaborative  care  showing  long-term  reductions  in  suicidal  ideation 
(12,  13).  These  findings,  though  preliminary,  are  important  in  the  face  of  recent  rises  in  the  U.S 
military  suicide  rate.  Indeed,  recent  research  in  serving  military  personnel  has  reinforced  the 
importance  of  mental  disorders  and  substance  misuse  as  key  risk  factors  (46). 

Two  previous  collaborative  care  trials  have  reported  primary  care  PTSD  outcomes. 
Schnurr  and  colleagues  (18)  found  no  benefit  associated  with  a  model  that  mainly  focused  on 


12 


psychiatrist-supervised  care  managers,  measurement-based  clinical  assessments  of  symptom 
severity,  and  stepped  pharmacologic  management.  More  recently,  Fortney  and  colleagues  (17) 
successfully  improved  PTSD  outcomes  using  a  collaborative  care  approach  to  PTSD  designed 
to  extending  the  reach  and  increasing  the  use  of  evidence-based  cognitive  processing  therapy. 
Our  trial  offered  stepped  psychosocial  and  pharmacological  intervention,  suggesting  that  greater 
emphasis  on  psychotherapeutic  approaches  may  be  an  instrumental  component  for  successful 
primary  care  approaches  to  collaborative  care  for  PTSD,  though  more  research  in  this  regard  is 
needed. 

Limitations  should  be  considered  when  interpreting  study  findings.  First,  the  intervention 
included  multiple  components  and  efforts  were  not  made  to  control  for  nonspecific  factors  such 
as  contact  time.  Hence,  we  are  unable  to  parse  the  specific  impact  of  intervention  components. 
Finally,  important  information  about  cost  and  cost-effectiveness  of  this  intervention  is  not  yet 
available  but  will  ultimately  help  inform  decisions  about  these  enhancements  and  their  overall 
value  to  improving  mental  health  among  military  personnel.  Our  forthcoming  work  will  explore 
experiences  of  patients  and  clinicians  from  a  qualitative  perspective  as  well  as  cost- 
effectiveness  analyses  to  help  policy-makers  weigh  the  value  of  this  intervention. 

In  summary,  we  conclude  that_greater  central  assistance  for  collaborative  telecare  and 
use  of  stepped  psychosocial  and  pharmacologic  management  is  likely  to  improve  primary  care 
outcomes  of  PTSD  and  depression  among  affected  military  personnel  and  offers  a  promising 
approach  for  other  populations  with  similar  problems.  These  data  also  add  to  the  emerging 
literature  on  the  effectiveness  of  collaborative  care  treatment  models  for  PTSD  more  generally. 
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Table  1.  Baseline  characteristics  of  666  randomized  study  patients. 


Characteristic 

CACT 

N=332 

n  (%)  or 

mean  (SD) 

Usual  Care 

N=334 

n  (%)  or 

mean  (SD) 

Demoaraphic 

Group(s) 

Gender 

Male 

264  (80%) 

275  (82%) 

Age 

Years 

28.7  (10.9) 

28.9  (11.4) 

Rank 

E1-E6 

297  (89%) 

283  (85%) 

Marital  Status 

Married 

222  (67%) 

224  (67%) 

Education 

>  High  School 

233  (70%) 

230  (69%) 

Race/Ethnicity 

White,  non-Hispanic 

158  (48%) 

160  (48%) 

Other,  non-Hispanic 

116  (35%) 

114  (34%) 

Hispanic 

57  (17%) 

60  (18%) 

Deployments  after  2001 

0 

59  (18%) 

55  (16%) 

1 

102  (31%) 

107  (32%) 

2 

82  (25%) 

77  (23%) 

>3 

89  (27%) 

95  (28%) 

Baseline  Clinical  Status 

High  Combat  Exposure1 

224  (67%) 

228  (68%) 

PTSD 

DSM-IV/  PCL-C2 

285  (86%) 

281  (84%) 

Depression 

PHQ-93 

224  (67%) 

208  (62%) 

PTSD  and  Depression 

193  (58%) 

177  (53%) 

PTSD  Severity 

PDS 

29.4  (9.4) 

28.9(8.9) 

Depression  Severity 

SCL-20 

2.1  (0.6) 

2.0  (0.7) 
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CACT 

Usual  Care 

N=332 

N=334 

n  (%)  or 

n  (%)  or 

Characteristic 

mean  (SD) 

mean  (SD) 

Alcohol  Consumption 

AUDIT-C 

3.0  (2.5) 

2.7  (2.3) 

Somatic  Symptoms 

PHQ-15 

14.1  (4.7) 

13.4(4.8) 

Physical  Health  Function 

SF-12,  PCS 

37.7  (10.0) 

36.8  (10.6) 

Mental  Health  Function 

SF-12,  MCS 

32.7  (9.6) 

34.4  (10.9) 

Pain  Intensity 

BPI 

5.7  (2.3) 

5.7  (2.4) 

Pain  Interference 

BPI 

5.0  (2.6) 

5.0  (2.7) 

1  High  combat  exposure  =  10+  points  on  Combat  Exposure  Scale. 

2  Meets  PCL-C  criteria  if  1  or  more  items  are  endorsed  for  Criterion  A,  3  or  more  for  Criterion  B, 
and  2  or  more  for  Criterion  C.  A  total  of  37  participants  were  not  asked  the  PCL  because  they 
did  not  meet  criteria  on  the  PC-PTSD  and  were  assumed  not  to  meet  PTSD  criteria 

3  Meets  PHQ-9  criteria  if  5  or  more  items  were  endorsed  for  “more  than  half  the  days”  and  one 
of  those  items  was  “little  interest  or  pleasure  in  doing  things”  or  “feeling  down,  depressed  or 
hopeless”. 

AUDIT-C=Consumption  items  of  the  Alcohol  Use  Disorders  Identification  Test 
PCL-C=PTSD  Checklist,  Civilian  Version 
PDS=PTSD  Diagnostic  Scale 

PHQ-9=Patient  Health  Questionnaire  depression  severity  score 
PHQ-15=Patient  Health  Questionnaire  somatic  symptom  severity  score 
SCL-20=Hopkins  Symptom  Checklist,  20  item  depression  screen 
SF-12,  MCS=SF-12  Mental  Component  Summary  score 
SF-12,  PCS=SF-12  Physical  Component  Summary  score 
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Table  2.  PTSD  and  depression  related  outcomes  among  study  patients. 


CACT 

Usual  Care 

Outcome 

(n=332) 

(n=334) 

Measure  (95%  Cl) 

p-value 

PTSD  (PDS)  Severity 

0  to  3  months 

-2.951  (0.53) 

-2.73  (0.54) 

-0.23  (-1.72,1.26) 

0.59 

0  to  6  months 

-4.86  (0.61) 

-3.42  (0.60) 

-1.43  (-3.11,  0.25) 

0.057 

0  to  12  months 

-6.07  (0.68) 

-3.54  (0.72) 

-2.53  (-4.47,-0.59) 

0.0029 

Depression  (SCL-20) 

0  to  3  months 

-0.291  (0.04) 

-0.20  (0.04) 

-0.08  (-0.19,  0.03) 

0.062 

0  to  6  months 

-0.44  (0.05) 

-0.25  (0.05) 

-0.19  (-0.32,  -0.06) 

0.0007 

0  to  12  months 

-0.56  (0.05) 

-0.31  (0.05) 

-0.26  (-0.41,  -0.11) 

<0.0001 

>50%  Improvement,  PTSD 

0.023 

0  to  3  months 

11.52 (36) 

9.5  (29) 

1.253  (0.74,  2.09) 

0.40 

0  to  6  months 

19.3  (58) 

13.4  (40) 

1.55  (0.99,  2.40) 

0.0510 

0  to  12  months 

25.0  (73) 

17.0  (49) 

1.62  (1.08,  2.43) 

0.0194 

>50%  Improvement,  Depression 

0.014 

0  to  3  months 

12. 22  (38) 

10.8  (33) 

1.143  (0.70,  1.88) 

0.60 

0  to  6  months 

21.3  (64) 

13.8  (41) 

1.70  (1.11,  2.61) 

0.0149 

0  to  12  months 

29.7  (86) 

20.6  (59) 

1.65  (1.13,  2.42) 

0.0100 

1  mean  (SE) 

2  percent  improved  (number  improved) 

3  odds  ratio  (95%  confidence  limits) 

PDS=PTSD  Diagnostic  Scale 

SCL-20=Hopkins  Symptom  Checklist,  20  item  depression  screen 
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Table  3.  Changes  in  secondary  outcomes  among  study  patients  from  baseline  to  each  follow-up 
assessment. 


CACT 

Usual  Care 

Measure  (95%  Cl) 

Overall  P  Value 

(n=332) 

(n=334) 

AUDIT-C,  mean  (SE) 

0.24 

0  to  3  months 

-0.26  (0.12) 

-0.29  (0.12) 

-0.04  (-0.28,  0.36) 

0  to  6  months 

-0.34  (0.13) 

-0.33  (0.12) 

-0.001  (-0.35,  0.35) 

0  to  12  months 

-0.54  (0.14) 

-0.20  (0.14) 

-0.33  (-0.72,  0.06) 

PHQ-15,  mean  (SE) 

0.0252 

0  to  3  months 

-1.12  (0.25) 

-0.58  (0.25) 

-0.53  (-1.22,  0.15) 

0  to  6  months 

-1.56  (0.26) 

-0.69  (0.29) 

-0.88  (-1.64,  -0.11) 

0  to  12  months 

-2.29  (0.33) 

-0.92  (0.31) 

-1.37  (-2.26,  -0.47) 

SF-12,  mean  (SE) 

Physical  (PCS) 

0.65 

0  to  3  months 

-1.02  (0.41) 

-1.16  (0.44) 

0.14  (-1.04,  1.31) 

0  to  6  months 

-0.64  (0.45) 

-1.10  (0.46) 

0.46  (-0.80,  1.72) 

0  to  12  months 

-1.11  (0.47) 

-1.25  (0.55) 

0.14  (-1.29,  1.57) 

Mental  (MCS) 

0.014 

0  to  3  months 

4.31  (0.65) 

4.13  (0.65) 

0.18  (-1.62,  1.98) 

0  to  6  months 

5.78  (0.74) 

3.51  (0.74) 

2.28  (0.23,  4.33) 

0  to  12  months 

8.10  (0.80) 

4.93  (0.82) 

3.17  (0.91,  5.42) 

Pain  Intensity,  mean  (SE) 

0.32 

0  to  3  months 

-0.17(0.13) 

0.02  (0.11) 

-0.19  (-0.51,  0.14) 

0  to  6  months 

-0.18  (0.13) 

0.08  (0.13) 

-0.26  (-0.61,  0.10) 
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0  to  12  months 

-0.25  (0.15) 

0.08  (0.12) 

-0.33  (-0.74,  0.07) 

Pain  Interference,  mean  (SE) 

0.36 

0  to  3  months 

0.09  (0.19) 

0.27  (0.13) 

-0.17  (-0.54,  0.20) 

0  to  6  months 

-0.05  (0.15) 

0.18  (0.14) 

-0.23  (-0.63,  0.18) 

0  to  12  months 

-0.19  (0.16) 

0.20  (0.17) 

-0.39  (-0.85,  0.07) 

AUDIT-C=Consumption  items  of  the  Alcohol  1 

Use  Disorders  Identification  Test 

PHQ-15=Patient  Health  Questionnaire  somatic  symptom  severity  score 
MCS=SF-12  Mental  Component  Summary  score 
PCS=SF-12  Physical  Component  Summary  score 
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Table  4.  Patient  reported  mental  health  service  use  by  treatment  group  (mean,  SE). 


Treatment  Effect 

CACT 

(n=332) 

Usual  Care 

(n=334) 

Measure  (95%  Cl) 

p** 

Individual  Therapy  Visits 

0.49 

3  months  prior  to  enrollment 

2.66*  (0.27) 

2.68  (0.45) 

-0.02  (-1.06,  1.01) 

0  to  3  months 

2.94  (0.26) 

2.86  (0.26) 

0.08  (-0.62,  0.79) 

3  to  6  months 

2.82  (0.29) 

2.32  (0.24) 

0.50  (-0.24,  1.24) 

6  to  12  months 

3.66  (0.47) 

3.55  (0.41) 

0.11  (-1.11,  1.33) 

Telephone  Contacts 

<0.0001 

3  months  prior  to  enrollment 

1.53  (0.14) 

2.56  (0.63) 

-1.03  (-2.30,  0.25) 

0  to  3  months 

3.05  (0.22) 

1.76  (0.13) 

1 .  29  (0.80,  1.79) 

3  to  6  months 

2.72  (0.31) 

1.46  (0.13) 

1.26  (0.59,  1.92) 

6  to  12  months 

3.30  (0.35) 

1.99  (0.22) 

1.31  (0.51,  2.12) 

Months  of  Depression  Medication1 

0.0129 

3  months  prior  to  enrollment 

0.67  (0.06) 

0.77  (0.06) 

-0.10  (-0.26,  0.07) 

0  to  3  months 

1.30  (0.07) 

1.13  (0.08) 

0.16  (-0.05,  0.37) 

3  to  6  months 

1.37  (0.08) 

1.22  (0.08) 

0.15  (-0.07,  0.37) 

6  to  12  months 

2.42  (0.16) 

2.02  (0.16) 

0.40  (-0.05,  0.84) 

Months  of  PTSD  Medication2 

0.0122 

3  months  prior  to  enrollment 

0.47  (0.05) 

0.51  (0.06) 

-0.04  (-0.18,  0.11) 

0  to  3  months 

1.05  (0.07) 

0.85  (0.07) 

0.20  (-0.003,  0.39) 

3  to  6  months 

1.20  (0.08) 

0.88  (0.08) 

0.32  (0.10,  0.53) 

6  to  12  months 

2.03  (0.16) 

1.60  (0.15) 

0.43  (0.003,  0.86) 

1  Any  antidepressant  medication 
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2  Any  selective  serotonin  reuptake  inhibitor  or  prazosin 
*  mean  (standard  error) 

**  p  for  treatment  difference  averaged  over  3-,  6-,  and  12-month  assessments 
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Figure  1.  Study  flow  diagram.  Percentage  in  gray  box  is  response  rate  by  follow-up  assessment 
and  treatment  arm. 
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Abstract 


Objective:  Over  the  past  decade,  there  has  been  growing  recognition  of  the  mental  health 
consequences  associated  with  deployment  and  service  among  military  service  personnel.  This  has 
also  resulted  in  increased  concerns  about  the  potential  barriers  that  members  of  the  military  may 
face  in  accessing  needed  services. 

Methods:  This  is  a  qualitative  study  of  stakeholders  within  the  context  of  a  large 
randomized  controlled  trial  being  conducted  across  6  larger  military  installations,  encompassing  18 
Army  primary  care  clinics.  Stakeholders  included  patients  recruited  for  the  study,  health  care 
providers  working  within  site  clinics,  and  the  care  managers  employed  within  the  study  to 
implement  the  intervention  protocol. 

Results:  Issues  raised  across  stakeholder  groups  fell  into  two  main  categories:  structural 
factors  associated  with  the  system  itself  and  institutional  attitudes  and  cultural  issues  across  the 
U.S.  military.  Structural  issues  included  concerns  about  the  existing  capacity  of  the  system,  for 
example  whether  there  were  enough  providers  available  to  address  the  populations'  needs  and  the 
constraints  on  clinic  hours  and  scheduling  practices.  The  institutional  attitude  and  cultural  issues 
fell  into  two  main  areas:  attitudes  and  perceptions  among  the  leadership  and  the  concern  that  those 
attitudes  could  result  in  negative  career  repercussions  for  those  who  access  care. 

Conclusions:  The  findings  reveal  that  despite  these  significant  efforts,  stakeholders  within 
the  Army  medical  system  still  perceive  significant  barriers  to  care.  Efforts  to  ensure  adequate, 
timely,  and  quality  access  to  mental  health  care  for  service  members  will  need  to  appropriately 
respond  to  capacity  constraints  and  organizational  and  institutional  culture. 
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Introduction 


Over  the  past  decade,  there  has  been  growing  recognition  of  the  mental  health 
consequences  associated  with  deployment  and  service  among  military  service  personnel  (1). 
Several  studies  have  revealed  the  prevalence  of  mental  health  problems  among  those  serving  in  U.S. 
Armed  Forces  (2,  3,  4,  5]  brought  increased  concerns  about  the  potential  barriers  that  members  of 
the  military  may  face  in  accessing  mental  health  services  (6,  7],  As  the  primary  source  of  health 
care  for  service  members,  the  military  health  system  (MHS]  bears  special  responsibility  in 
addressing  these  issues.  With  9.6  million  beneficiaries,  56  inpatient  hospitals  and  medical  centers 
and  360  ambulatory  care  clinics,  the  MHS  represents  one  of  the  largest  health  systems  in  the  U.S. . 

Within  the  U.S.,  the  primary  care  system  has  often  been  referred  to  as  the  de  facto  mental 
health  system  (8,  9, 10],  and  the  same  holds  true  for  the  MHS  where  service  members  have  an 
average  of  three  encounters  per  year  (11].  Over  the  past  two  decades,  there  have  been  multiple 
efforts  implemented  within  and  across  different  health  care  systems  seeking  to  integrate  behavioral 
health  into  primary  care  settings.  These  interventions  are  collectively  referred  to  as  "collaborative 
care"  with  the  goal  of  integrating  and  improving  mental  health  services  delivered  in  primary  care. 
Common  components  of  these  models  include  [1]  efforts  to  prepare  the  practice  setting;  [2]  use  of  a 
team  approach,  most  often  including  a  care  manager  for  engaging  patients,  improving  their 
adherence  to  treatment,  and  assessing  treatment  response,;  and  3]  strategies  to  enhance  the 
interface  between  specialists  and  primary  care  [12],  Within  the  MHS,  there  have  been  several 
attempts  over  the  past  decade  to  integrate  behavioral  health  care  expertise  and  opportunities  into 
primary  care  settings  and  into  line  units.  In  2007,  the  Army  began  integrating  mental  health  into  all 
of  its  primary  care  clinics  to  include  the  colocation  of  mental  health  specialists  and  the  use  of  nurse 
care  managers  (13, 14],  In  2013,  they  expanded  the  assignment  of  trained  behavioral  health 
clinicians  to  line  units  and  troop  medical  clinics.  These  efforts  were  intended  to  expand  access  and 
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reduce  the  potential  concerns  among  soldiers  associated  with  seeking  help.  However,  despite  these 
efforts,  access  and  quality  of  military  mental  health  services  remain  a  concern  (1, 15). 

We  implemented  a  qualitative  study  designed  to  understand  stakeholder  experiences  with 
respect  to  the  treatment  of  PTSD  and  depression  within  the  U.S.  Army  (16).  Specifically,  we 
gathered  participant  perspectives  on  the  facilitators  and  barriers  to  accessing  and  utilizing  mental 
health  care  within  the  US  Army.  In  addition  to  gathering  insights  with  respect  to  obstacles  and 
barriers,  we  asked  patients  for  their  recommendations  on  approaches  that  might  increase  help 
seeking  among  soldiers  with  mental  health  problems. 

Methods 

We  conducted  a  series  of  qualitative  interviews  with  study  stakeholders  within  the  context 
of  a  large  randomized  controlled  trial  designed  to  test  the  effectiveness  of  a  centrally-assisted 
stepped  care  model  for  PTSD  and  depression.  This  study  was  being  conducted  across  6  larger 
military  installations  from  which  service  members  deployed  and  returned,  encompassing  18  Army 
primary  care  clinics  (16).  Stakeholders  included  U.S.  Army  soldiers  recruited  for  the  study,  health 
care  providers  working  within  clinics  at  each  of  the  six  sites,  and  the  care  managers  employed 
within  the  study  to  implement  the  intervention  protocol.  Patient  participants  were  drawn  from 
both  intervention  arms  in  the  study,  an  enhanced  stepped-collaborative  care  model,  and  the 
standard  version  of  collaborative  care  offered  throughout  the  military  health  system.  Procedures 
were  approved  by  all  relevant  Institutional  Review  Boards.  All  interview  stakeholders  provided 
oral  consent  for  participation. 

Patients.  We  randomly  selected  patients  within  each  site  to  participate  in  up  to  3,  30  minute 
interviews.  We  randomly  drew  the  names  and  contact  information  for  patients  on  a  rolling  basis 
across  the  one-year  study  enrollment  period  at  each  site.  At  each  site,  we  attempted  to  recruit  six 
patients,  two  from  each  site  (one  from  each  of  the  intervention  conditions)  for  a  total  of  36  patients 
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across  the  study.  After  sending  an  introductory  email,  we  attempted  to  contact  the  patient  by 
phone  to  ascertain  their  willingness  to  participate  and  schedule  an  interview  session.  Of  60 
soldiers  invited  to  participate,  we  were  unable  to  reach  14  of  them, 3  declined  participation,  and  5 
patients  were  "no-shows"  for  their  first  scheduled  interview. 

Once  recruited,  each  patient  was  asked  to  participate  in  up  to  3  interviews  across  the  one- 
year  time  span  for  their  own  study  participation.  Interviews  were  scheduled  to  occur  within 
approximately  1-2  months  from  the  soldier's  start  in  the  study,  4-5  months  from  start,  and  7-8 
months  from  start.  For  some  patients,  delays  in  scheduling  interviews  increased  the  interval 
between  appointments.  Of  the  38  patients  who  participated  in  the  initial  interviews,  31  (81.5%] 
completed  at  least  two  interviews,  and  27  [71%]  completed  all  three  interviews.  Table  1  displays 
the  demographic  characteristics  of  the  patients  interviewed. 

All  interviews  were  conducted  over  the  phone  by  trained  qualitative  interviewers  (TT,  LHJ, 
CF]  as  well  as  a  note-taker.  Using  a  semi-structured  interview  guide  we  asked  about  their 
expectations  about  study  participation,  their  experiences  with  getting  into  care  and  working  with 
their  assigned  care  manager,  their  utilization  of  mental  health  care  and  resources  to  date,  to  include 
asking  about  any  barriers  or  facilitators  that  they  experienced,  their  utilization  of  specific  study 
tools  and  any  recommendations  they  had  for  improving  the  delivery  of  mental  health  care  to 
soldiers  with  PTSD  or  depression.  All  interviews  were  recorded  and  transcribed,  and  lasted  less 
than  30  minutes.  Once  transcripts  were  verified,  recordings  were  deleted.  Patients  received  a  $25 
Amazon  gift  card  following  each  interview  they  completed,  for  a  potential  total  of  $75  for 
participating  in  all  three  interviews. 

(insert  Table  1  about  here) 

Providers.  Given  the  absence  of  centralized  rosters  of  providers,  we  asked  the  Study  Site 
Coordinators  and  Site  Principal  Investigators  to  share  lists  of  all  health  care  providers  working 
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within  the  installation  clinics,  by  setting  and  specialty  type.  From  among  these  lists  at  each  site,  we 
sought  to  recruit  roughly  the  same  number  of  general  medicine  providers  (physicians,  physician 
assistants,  nurse  practitioners)  and  mental  health  specialty  providers  (psychiatrists,  psychologists, 
social  workers).  For  the  mental  health  providers,  we  attempted  to  select  providers  from  those 
working  in  primary  care  settings,  behavioral  health  specialty  clinics,  and  those  embedded  in 
operational  units.  We  sought  to  recruit  five  providers  per  site  and  randomly  chose  individuals  from 
the  lists  provided  from  the  sites  until  we  reached  our  target  at  each  location.  We  contacted  a  total 
of  100  providers  across  the  6  sites,  and  interviewed  31  providers  in  total.  Providers  were  asked  to 
participate  in  one,  15-30  minute  interview  about  their  experiences  addressing  soldiers'  mental 
health  needs,  delivering  behavioral  health  within  the  MF1S,  and  about  any  specific  experience 
related  to  the  study.  Participating  providers  were  provided  with  a  $35  amazon  gift  card  as  a  token 
of  appreciation.  Table  2  shows  the  characteristics  of  the  participating  providers. 

(insert  Table  2  about  here) 

Care  managers.  The  seven  care  managers  (licensed  nurses  responsible  for  managing 
specific  patients)  working  within  the  study  included  six  assigned  to  and  located  at  a  specific  site 
and  one  who  was  centrally  located  and  provided  back  up  or  overflow  care  management;  six  of  the 
seven  were  female.  They  were  asked  to  participate  in  two,  one-hour  interviews  about  their 
experiences  working  with  the  patients  and  providers  within  the  study  context.  The  timing  of  the 
interviews  was  based  upon  the  study's  lifecycle:  once  within  the  first  3  months  of  their  site's  study 
enrollment  and  once  within  the  last  month  of  the  study.  All  interviews  were  conducted  by  phone 
and  followed  a  semi-structured  protocol  by  a  trained  qualitative  interviewer  (CF)  who  was  assisted 
by  a  note-taker.  The  early  and  late  interview  discussion  guide  covered  a  range  of  topics,  including 
their  experiences  engaging  patients  into  care,  sharing  information  with  providers  both  on  and  off¬ 
site,  and  their  perceptions  of  the  specific  study  tools  and  resources  they  were  provided.  During  the 
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final  interview,  we  also  used  a  medical  record-assisted  recall  approach  to  foster  feedback  on  their 
experiences  with  respect  to  five  specific  cases  that  they  managed.  Patients  for  the  medical  record- 
assisted  recall  methods  were  randomly  chosen  from  among  all  intervention  patients  within  that 
site,  and  names  were  provided  to  the  care  manager  at  the  time  of  the  interview.  All  interviews  were 
recorded  and  transcribed.  Once  transcripts  were  verified,  recordings  were  deleted.  Care  managers 
were  offered  a  $75  Amazon  gift  card  as  a  token  of  appreciation  for  completing  the  interviews. 

Analysis.  All  transcripts  were  coded  by  a  single  coder  (MW  for  patients,  CB  for  providers, 
and  SM  for  care  managers]  using  ATLAS.ti  qualitative  data  analysis  software  and  a  coding  scheme 
developed  by  the  team.  The  scheme  was  drafted,  used  to  code  five  transcripts,  checked  by  the 
analytic  team  and  refined/expanded,  prior  to  use  on  all  transcripts.  Once  all  transcripts  were 
coded,  quotes  were  sorted  and  reviewed  to  inform  the  analyses. 

Results 

A  total  of  76  stakeholders  were  interviewed  between  July  2012  and  June  2014  about  the 
issues  associated  with  delivering  mental  health  care  to  soldiers  with  posttraumatic  stress  disorder 
or  depression  within  the  MHS.  During  these  discussions,  stakeholders  discussed  a  number  of  issues 
that  both  promote  and  inhibit  timely  access  to  and  receipt  of  high  quality  mental  health  care.  Issues 
raised  across  stakeholder  groups  fell  into  two  main  categories:  structural  factors  associated  with 
the  system  itself  and  institutional  attitudes  and  cultural  issues  across  the  U.S.  military.  We  discuss 
these  concerns  within  each  category,  as  voiced  by  the  stakeholders,  below.  We  also  discuss  the 
recommendations  that  stakeholders  provided  for  increasing  access  to  mental  health  services  for 
soldiers  and  their  families. 

Structural  Issues 
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Stakeholder  respondents  raised  a  number  of  issues  associated  with  the  structure  of  the 
Army  health  care  system  as  potential  facilitators  and  barriers  to  delivering  care.  These  included 
concerns  about  the  existing  capacity  of  the  system,  for  example  whether  there  were  enough 
providers  available  to  address  the  populations'  needs.  This  issue  was  raised  by  patients  as  well  as 
providers  (see  Table  1  for  illustrative  quotes]  and  noted  as  a  problem  particularly  with  respect  to 
ensuring  timely  access  to  appointments.  A  second  structural  concern  raised  included  the 
constraints  on  clinic  hours  and  scheduling  practices.  Patients  and  providers  spoke  to  the  limited 
time  a  provider  has  during  each  visit  to  tend  to  the  patient's  full  range  of  concerns.  At  the  same 
time,  many  providers  (particularly  those  engaged  in  trying  to  do  follow  up  telephone  care]  and  care 
managers  mentioned  concerns  about  their  work  hours  overlapping  with  the  work  hours  for  their 
patients,  making  it  nearly  impossible  to  reach  them  by  phone  during  the  day.  The  structure  of  the 
medical  care  system  within  the  military  is  such  that  appointments  are  only  offered  during  duty 
hours,  requiring  that  service  members  request  an  absence  from  their  supervisors  or  commanders 
to  attend.  This  renders  their  health  care  subject  to  the  varying  knowledge,  attitudes,  beliefs,  and 
will  of  their  commanders,  which  is  discussed  as  an  area  of  concern  below. 

(insert  Table  3  about  here) 

Institutional  Attitudes  and  Culture 

Among  the  issues  that  stakeholders  raised  as  concerns  with  respect  to  service  members 
accessing  care  included  those  associated  with  the  attitudes  and  culture  within  the  Army  as  an 
institution  and  workplace  setting.  These  cultural  issues  fell  into  two  main  areas:  those  associated 
with  attitudes  and  perceptions  among  the  leadership  and  the  concern  that  those  attitudes  could 
result  in  negative  career  repercussions  for  those  who  access  care.  Soldiers,  their  providers,  and  the 
care  managers  each  voiced  concerns  over  attitudes  among  leaders  and  their  willingness  to  allow 
soldiers  to  schedule  appointments.  Some  patients  were  also  concerned  that  by  requesting  time  off 
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and  attending  such  visits,  that  they  would  experience  adverse  career  impacts  either  through  fewer 
promotion  opportunities  or  even  being  flagged  for  separation  from  the  military. 

{insert  Table  4  about  here) 

Stakeholder  Recommendations  for  Improving  Access  and  Receipt  of  Care 

During  each  patient  interview,  we  asked  for  suggestions  on  how  to  overcome  barriers  and 
improve  access  to  mental  health  care  for  soldiers.  While  we  did  not  specifically  ask  for 
recommendations  from  nurse  care  managers  or  providers,  those  stakeholders  also  provided  some 
ideas  spontaneously.  Common  recommendations  offered  included  the  expanding  access  for 
soldiers  and  their  families  to  resources  available  off  of  the  installation.  Soldiers  mentioned  that  not 
only  were  community  resources  available,  but  often  they  were  preferred  because  of  the  greater 
perceived  likelihood  of  confidentiality  and  availability  during  non-work  hours.  Other  suggestions 
included  addressing  the  attitudes  of  leadership  directly  through  targeted  training  programs. 

Several  stakeholders  commented  that  military  leaders  needed  to  have  greater  awareness  of  mental 
health  challenges  and  issue  facing  soldiers  and  to  be  taught  how  to  be  more  empathic  and  how  to 
facilitate  soldier's  receipt  of  care.  Others  mentioned  the  need  to  encourage  providers  to 
communicate  directly  with  command  when  there  is  a  lack  of  support  for  service  members  in 
keeping  their  appointments. 


(insert  Table  5  about  here) 

Conclusions 

Ensuring  access  to  mental  health  services  for  U.S.  service  members  has  been  the  focus  of 
several  national  efforts,  including  a  Presidential  Executive  Order  (17).  The  Department  of  Defense 
and  each  of  the  military  services  have  implemented  many  programs  designed  to  raise  awareness, 
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promote  help  seeking  and  expand  workforce  capacity  (18).  Our  findings  reveal  that  despite  these 
significant  efforts,  stakeholders  within  the  Army  medical  system  still  perceive  significant  barriers  to 
care.  Our  study  queried  patients  seeking  access  to  mental  health  care  within  the  Army  medical 
system,  as  well  as  those  who  were  responsible  for  providing  and/or  facilitating  such  care,  and  we 
found  significant  overlap  among  stakeholders  with  respect  to  the  obstacles  and  challenges  soldiers 
face  in  trying  to  get  help  for  mental  health  concerns. 

Many  have  suggested  that  the  greatest  barrier  to  receiving  and  staying  in  care  among 
military  personnel  was  related  to  "stigma"  among  soldiers  (5, 19,  20),  and  we  found  evidence  of  this 
issue  among  all  of  our  stakeholders.  However,  even  more  frequently,  stakeholders  raised  concerns 
to  be  around  the  structural  aspects  of  the  medical  system  as  well  as  the  cultural  aspects  within  the 
Army  as  an  institution.  These  issues  are  of  particular  concern  given  that  they  are  occurring  within  a 
system  where  efforts  have  been  implemented  to  increase  identification  of  mental  health  problems 
and  facilitate  access  to  mental  health  services  and  support  (18).  All  of  the  service  members  in  our 
study  were  identified  as  having  a  mental  health  problem  and  were  assigned  to  a  care  manager  to 
help  them  navigate  care  and  obtain  needed  appointments.  Yet,  our  stakeholders  still  noted 
significant  structural  and  organizational  barriers  to  securing  timely  care. 

Patients  and  providers  both  perceived  a  shortage  of  professionals  and  expressed  frustration 
over  the  resulting  long  wait-times  for  appointments.  Providers  further  noted  that  the  short  visit 
times  limited  their  ability  to  attend  to  all  of  the  patient's  concerns,  including  those  related  to  mental 
health.  Addressing  these  concerns  will  involve  considering  structural  changes  to  improve  the 
systems  of  mental  health  service  delivery,  such  as  hiring  more  mental  health  providers,  expanding 
access  to  off-post  mental  health  providers,  lengthening  the  time  allotted  for  primary  care  sessions, 
and  expanding  clinic  hours  to  offer  appointments  during  evenings  and  weekends. 
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Patients  and  providers  also  both  noted  that  the  attitudes  among  Army  leadership  were  a 
significant  barrier  for  soldiers  who  needed  and/or  wanted  to  get  help.  A  handful  of  other  studies 
have  also  documented  the  influence  of  poor  leadership  on  not  only  the  experience  of  post¬ 
deployment  mental  health  problems  (21]  but  also  on  the  level  of  stigma  and  help  seeking  behaviors 
among  soldiers  (5, 19,  20],  Britt  et  al.,  2012  found  that  leaders  who  engaged  in  negative  behaviors, 
such  as  embarrassing  unit  members  in  front  of  others,  were  more  likely  to  create  work 
environments  conducive  to  higher  levers  of  stigma  concerning  mental  health  care  among  their 
soldiers  [22].  Our  stakeholders  reported  that  getting  the  approval  to  leave  work  and  attend 
appointments  may  be  intimidating  and  stakeholders  mentioned  that  many  feared  the  potential  for 
adverse  career  repercussions  if  they  did  so.  Britt  et  al.,  2012  also  observed  that  those  leaders  who 
engaged  in  more  positive  behaviors  were  the  ones  more  likely  to  make  accommodations  for  those 
seeking  treatment.  Taken  together,  these  findings  suggest  that  improving  and  changing  military 
leader  attitudes  about  mental  health  and  behaviors  may  be  an  important  tool  in  facilitating  help 
seeking  for  soldiers.  Given  the  multiple  levels  of  leadership  within  the  military,  these  efforts  need 
to  cover  all  of  them,  including  senior,  mid  and  junior  grade  officers  to  ensure  we  tend  to  all  of  the 
micro-cultures  within  the  overall  military  command  climate.  Within  the  first  responder  community, 
other  agencies  have  implemented  Psychological  First  Aid  for  Leaders  as  an  approach  to  change  how 
leaders  understand  and  respond  to  individuals  who  experience  mental  health  issues  (See: 
www.phe.gov/abcl.  This  course  may  serve  as  a  model  for  the  Department  of  Defense  as  it 
continues  to  address  barriers  to  mental  health  among  service  members  and  promote  more  support 
work  environments. 

Military  service,  particularly  during  a  period  of  active  combat  deployments,  is  arguably  one 
of  the  most  stressful  occupations.  Given  added  concerns  about  trauma  exposures,  both  pre  and 
post  service  and  deployment,  there  is  sound  basis  to  enhance  access  to  mental  health  services  for 
our  service  members.  The  issues  and  concerns  regarding  the  role  of  the  leadership  and 
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commanders  in  influencing  service  members'  willingness  and  ability  to  seek  such  care  is  of 
significant  concern.  Particularly  in  light  of  the  ability  of  leaders  and  commanders  to  access  medical 
records  (23]  and  can  be  often  considered  part  of  the  health  care  team.  These  factors  suggest 
increased  importance  on  the  need  to  establish  they  are  not  in  fact  barriers,  but  rather  facilitators  in 
ensuring  access  to  needed  mental  health  care  for  their  troops. 

A  few  study  limitations  should  be  noted,  specifically,  our  data  was  collected  from  among 
patients  who  had  already  successfully  overcome  some  of  the  barriers  they  mentioned  to  receive 
care  in  settings  that  are  relatively  robust.  As  such,  their  concerns  may  under  represent  other 
barriers  facing  service  members  in  other  military  health  system  settings  or  other  types  of  barriers. 
Further,  these  data  were  collected  from  within  Army  clinics,  it  is  unclear  to  what  extent  the  same 
issues  would  be  identified  among  patients  in  clinics  managed  by  other  Services.  However,  we 
expect  the  regulatory  tensions  between  the  military  unit  and  those  seeking  military  medical  care 
are  likely  to  remain  qualitatively  similar. 
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Tables 


Table  1.  Participating  Patient  Characteristics 


Enhanced.  Stepped 
Collaborative  Care 

fN=191 

Usual  Collaborative 

Care  fN=191 

ALL  fN =384 

%  Male 

68.4% 

63.2% 

68.4% 

Mean  Age 

31.9  years 

28.8  years 

30.3  years 

Rank 

Enlisted 

52.6% 

47.4% 

52.6% 

Officer 

42.1% 

42.1% 

42.1% 

Missing 

5.3% 

10.5% 

7.9% 

Marital  Status 

Single 

47.4% 

57.9% 

55.3% 

Married  or  Living  with  Partner 

21.1% 

15.8% 

18.4% 

Separated/Divorced/Widowed 

26.3% 

15.8% 

21.1.% 

Missing 

5.3% 

10.5% 

7.9% 

Note:  percentages  may  not  add  to  100%  due  to  rounding. 
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Table  2.  Provider  Characteristics 


ALL  fN=311 

%  Male 

54.8% 

Setting 

PC  Clinic 

71.0% 

Specialty  Clinic 

12.9% 

Embedded  in  Unit 

16.1% 

Provider  Tvpe 

Behavioral  Health  (psychologist,  social  worker, 

psychiatrists] 

41.9% 

Primary  Care  (Physician  Assistants,  Nurse 

Practitioners,  Medical  Doctors] 

58.1% 
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Table  3:  Stakeholder  Perceptions  of  Structural  Barriers  to  Care 


Limited  Provider  Capacity 
Restricts  Timely  Access  to 
Appointments 


"The  workload  is  very  high.  I  am  new  and  the  population  of  clients  coming  through  the  door  is  non-stop."  [BH 
Provider] 

"Capacity  to  serve  the  high  need  for  care  is  an  issue. ...I  am  running  out  of  places  to  send  my  patients.  1  don’t 
have  any  place  to  send  acute  patients.  We  need  more  capacity."  [PC  Provider] 

"Patients  are  unable  to  get  appointments,  which  disrupts  continuity  of  care."  [BH  Provider] 

"What  we’re  having  is  not  enough  appointments  for  the  soldiers,  they’re  only  booked  once  a  month,  so  they  feel 
like  they’re  not  getting  enough  care,  as  much  as  they  need."  [Care  Manager] 

"I  just  want  to  know  what’s  going  on.  When  you’re  told  you  may  have  a  problem. ..I  want  some  answers  sooner 
than  three  weeks  away."  [Enhanced  Collaborative  Care  Patient] 

"My  next  appointment  should  be  in  the  next  week  and  I  have  an  appointment  every  2-3  weeks  or  so.  If  I  feel 
like  it  needs  to  be  more  - they  talked  about  referring  me  off-post."  [Usual  Care  Patient] 

"One  month  I  could  go  to  this  particular  care  provider  and  then  not  even  a  week  later,  I'm  speaking  with 
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someone  else.  And  it's  one  of  those  things  where  the  turnover  rate  or  whatever  was  like  super  high."  [Usual 


Care  Patient] 

"Some  of  the  appointment  wait  times  are  2-3  weeks."  [Behavioral  Health  Provider] 

"Most  PTSD  clinics  or  wounded  warrior  clinics  are  full  and  the  wait  times  are  long. "  [Primary  Care  Provider] 

"Some  of  the  challenges  might  be  availability.  We  don’t  have  enough  staff  to  see  people  on  a  weekly  basis.  We 
have  struggled  to  see  suicidal  patients  weekly.  [We  have  seen]  800  patients  last  monthly  3  weeks.  We  have 
three  full-time  therapists  and  two  part-time  therapists.”  [Behavioral  Health  Provider] 

Constraints  on  Provider's  "Another  part  of  the  issue  is  my  time.  If  I  had  the  time  to  make  phone  calls  and  do  virtual  follow  [follow  up  by 

Time  for  Appointments  and  phone  or  email],  I  would  do  it."  [PC  Provider] 

Follow  up 

7  have  had  a  hard  time  contacting  service  members  who  work  the  same  hours  that  I  do”  [Care  manager] 

"And  every  time  I  called  back  it  was,  "Oh,  call  back  next  week.  Call  back  next  week.  Sometimes  one  of  the  big 
things  is  just  the  feeling  I  get  is...  especially  if  you  're  trying  to  get  the  information  over  the  phone. ..is  you  get  the 
feeling  that  it's  not  really  their  priority  to  get  you."  [Usual  Care  Patient] 

"Limitations  make  it  tough  to  treat  PTSD.  Providers  have  limitations  in  terms  of  duration  of  time  and  numbers 
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of  appointments.  Iam  supposed  to  limit  visits  to  four  per  problem.  This  is  not  set  in  stone. My  appointments  are 


also  limited  to  30  minutes."  [Behavioral  Health  Provider] 

"In  terms  of  appointment  time,  an  8  to  15  minute  allotment  is  not  enough  time."  [Primary  Care  Provider] 

"In  addition  to  the  large  patient  load  and  the  short  appointment  times,  the  overall  complexity  ofPTSD  is  the 
issue."  [Primary  Care  Provider] 

7  think  the  main  issue  is  time.  The  therapies  are  supposed  to  be  90  minutes  long,  but  we  don’t  have  time  for 
that.  Most  appointments  are  60  minutes.  So  we  don’t  follow  that  guidance."  [Behavioral  Health  Provider] 

"We  do  use  those  EBP  skills,  but  we  need  to  modify  them  because  of  the  constraints  of  30-minute  appointments 
that  are  short-term.  I  modify  the  EBPs  to  help  the  patient."  [Behavioral  Health  Provider] 

"As  an  Embedded  Provider,  we  are  limited  in  time  -  so  we  can’t  spend  as  much  time  or  have  as  many  visits  as 
we  would  have  had  we  been  in  traditional  behavioral  health  settings.  You  can  request  additional  visits,  but 
must  get  authorizations  after  significant  justification  for  the  "extra"  time.  We  are  limited  to  30-40  minute 
sessions."  [Behavioral  Health  Provider] 

Work  Hours  Conflict  with  And  that's  why  I  didn 't  go  to  like  that  support  group  that  1  was  recommended,  because  it's  hard  to  get  off  work 

Clinic  Hours  during  the  day  and  then  be  gone  without  having  to  make  up  a  lie  about  why  I’m  leaving."  [Usual  Care  Patient] 
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" That  is  a  lot  of  it  because  like  our  unit,  they  don't  like  us-like  Mondays,  Wednesdays,  and  Fridays  have  pretty 
much  [been]  deemed  out, you  know, you  can't  have  appointments  on  these  days  unless  they're  after  hours.  And, 
you  know,  just  having  Tuesdays  and  Wednesdays  or, you  know,  trying  to  make  an  appointment  on  an  evening, 
a  lot  of  times  you  can’t,  you  know."  [Usual  Care  Patient] 
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Table  4:  Stakeholder  Perceptions  of  Institutional  Attitudes  and  Cultural  Barriers 


Leadership  Attitudes  and 
Perception  Influence  Soldier 
Willingness  to  Access  Care 


"My  chain  of  command  does  not  believe  me  either.  I  guess  they  don’t  think  anything  is  wrong  with  me. ...so 
they’re  really  giving  me  a  hard  time."  [Enhanced  Collaborative  Care  Patient] 

"The  major  challenge  we  face  is  really  being  able  to  ensure  the  soldier  can  get  time  off  to  attend  visits  and  get 
the  needed  care.  They  have  difficulty  getting  chain  of  command  to  allow  them  time  off  or  getting  excused  from 
the  field."  [PH  Provider] 

" They  [chain  of  command]  give  me  a  hard  time  for  going  to  appointments.  They  say  I  always  have 
appointments  and  they  always  want  me  to  bring  a  note  in,  bring  a  note  after  I'm  done.."  [Usual  Care  Patient] 

" The  command  is  not  very  willing  to  release  patients  for  therapy.  When  soldiers  are  in  the  field,  they  cannot 
leave."  [BH  Provider] 

"Sometimes  I  don’t  think  they  understand  the  challenges  that  I’m  facing,  and  there  isn’t  a  lot  of  empathy  for — 
and  I  guess  they  don’t  understand  the  need  for  me  to  have  an  appointment  during  the  work  day.  So  it  makes  it 

very  difficult . I  have  like  three  appointments  a  month,  I  already  get  a  lot  of  flak  for  that,  and  I'm  definitely 

looked  down  upon."  [Enhanced  Collaborative  Care  Patient] 
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"As  much  as  they  talk  about  getting  help  if  you  need  it,  they  still  have  this  tendency  to  portray  that  its 
weakness.  The  sergeant  major  in  my  unit  has  told  people  to  stop  making  appointments  or  they  can’t  have  any 
more  appointments  for  now  and  to  stop  making  appointments  to  get  out  of  work."  [Enhanced  Collaborative 
Care  Patient] 

"My  chain  of  commanders  don 't  believe  me  either.  I  guess  they  don 't  think  anything  is  wrong  with  me  too.  [my 
leadership]  is  all  males,  so  they're  really  giving  me  a  hard  time.  I  have  to  go  to  [XXX]  all  the  time,  and  it  doesn't 
do  anything.  I  just  want  to  get  out  because  I  can 't  do  anything  with  that  Army  anymore."  [Enhanced 
Collaborative  Care  Patient] 

"The  major  challenge  we  face  is  really  being  able  to  ensure  the  soldier  can  get  time  off  to  attend  visits  and  get 
the  needed  care.  They  have  difficulty  getting  chain  of  command  to  allow  them  time  off  or  getting  excused  from 
the  field."  [Primary  Care  Provider] 

"The  command  is  not  very  willing  to  release  patients  for  therapy.  When  soldiers  are  in  the  field  they  cannot 
leave.”  [Behavioral  Health  Provider] 

"Availability  is  an  issue.  Command  support  for  time  away  is  another  issue.  Command  support  of  behavioral 
health-  could  be  improved.  It  is  variable  from  person  to  person."  [Behavioral  Health  Provider] 
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‘Follow-up  is  good.  We  have  good  relationship  with  the  chain  of  command.  Our  Physician’s  Assistants  can  also 


follow  up  well."  [Behavioral  Health  Provider] 

Concern  about  Negative  "They’re  petrified,  a  lot  of  them,  that  if  they  tell  you  what’s  going  on,  that  they  will  be  kicked  out  of  the  service, 

Career  Impact  even  though  they’re  told  they’re  not  going  to,  that  stigma  is  still  there  for  a  lot  of  soldiers."  [Care  manager] 

"That’s  why  most  of  the  time  they  just  don’t  say  anything.  Because  they’re  afraid  that,  because  of  the 
downsizing,  that  they’ll  be,  end  up  getting  chaptered  out.”  [Care  manager] 

"And  you  don’t  want  to  tell  your  boss  that  you  have  an  appointment  for  something  behavioral  health.  You  like 
to  hide  those  problems.  I  feel  that  I  look  inferior  if  I,  you  know--I  just  like  to  tell  them,  hey,  I  have  this  issue  and 
I'm  dealing  with  it.  But  if  I,  you  know,  have  to  bring  it  up  every  couple  weeks  to  say  I  have  an  appointment--I 
have  to  go  here  for  this-you  don't  want  it  that  visible.  You  want  to  look  like  you  can  always  do  your  job,  no 
matter  what."  [Enhanced  Collaborative  Care  Patient] 

7  can’t  receive  the  treatment  that  I  need  because  of  my  job.  So  it  comes  down  to  a  point  where  I  can  choose  my 
professional  career  and  what  supports  my  family  or  what  I  actually  need.  And  it’s  sad  that  it’s  like  that.  ”  [Usual 
Care  Patient] 

7  don’t  want  to  tell  my  boss  that,  "Hey,  I  got  a  counseling  appointment."  You  just  always  want  to  appear  that 
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you  can  do  everything  and  you  don’t  need  help.  I  think  maybe  they  just  wouldn’t  look  at  me  the  same.  It’s  one 
thing  to  say-because  I  had  to  tell  my  boss  that  I  have  a  problem  going  into  the  OR.  I  got  a  little  PTSD  stuff 
going  on  with  that.  And  it’s  one  thing  to  tell  her  that  and,  '‘Hey,  I'm  trying  to  work  on  it;  I'm  getting  a  little 
counseling."  It’s  another  to  go  up  every  week  or  two  and  say,  "Hey,  I  got  to  go  for  an  appointment.  I'm  leaving  a 
few  hours  early."  I  think  you  just  don’t  look  quite  as  competent,  not  as  self-sufficient,  you  know?"  [Enhanced 
Collaborative  Care  Patient] 
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Table  5:  Stakeholder  (Patients]  Recommendations  for  Encouraging  Help  Seeking 


Expanding  Access  to 
Off-Post  Resources 


"The  only  thing  I’d  think  of  is  if  there  would  be  a  way  that  they  could  either  contract  out  to  civilian  doctors  off 
post  or  something  like  that.  That  way  they  would  be  able  to  lower  the  caseload  and  not  have  to  wait  a  month, 
month  and  half  for  your  next  appointment."  [Enhanced  Collaborative  Care  Patient] 

7  think  it’d  be  easier  to  have  more  stuff  [we]  can  do  outside  of  work . as  well  as  having  places  that  you  can  go 

outside  of  work. ...so  having  an  option  to  go  to  after  duty  hours  or  on  weekends  or  something  like  that  would  be 
nice."  [Enhanced  Collaborative  Care  Patient] 

"[Off-post  provider]  has  been  a  lot  better  and  talking  to  [my  care  manager]  on  the  phone  has  been  good  enough. 
I  don’t  think  he  [Off-post  provider]  comes  from  [a  perspective  of]  defending  the  military  and  telling  me  that  it’s 
ok  what  they  are  doing  to  me.  He’s  not  like  the  lady  I  as  seeing  who  was  military.  He  listens  to  how  I  feel  and 
helps  me  cope  with  it  better.  He’s  not  telling  me  how  they  [the  military]  see  it  or  trying  to  make  me  change  my 
opinion.  I  can  tell  him  exactly  what’s  on  my  mind  and  how  I  feel  without  him  telling  me  that  I  knew  that  when  I 
joined,  or  that’s  how  it  is."  [Enhanced  Collaborative  Care  Patient] 

7  would  say  the  only  thing  would  be  to  work  on  not  having  it  so  difficult  to  go  to  a  civilian  provider.  The  process 
of  having  to  go  on  post  for  X  amount  of  visits  before  you  can  get  a  referral  to  go  see  somebody  else  is  kind  of 
ridiculous,  because  if  you  have  somebody  like  me--like  if  I  could  have  1  would  have  gone  off  post  immediately 
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because  I  don’t  want  to  have  anything  to  do  with  the  on-post  counselors  because  of  the  generalization  and  the 
stigmatism  that  carries.  I  would  have  gone  off  post  originally.  But  a  lot  of  times  that  isn’t  a  very  easy  option." 
[Usual  Care  Patient] 


Training  Leadership 


"It’s  worlds  different.  I  think  the  thing  with  on-post  is  they  just,  in  their  mind,  they  already  have  an  agenda  and 
they  already  think  they  know  what  you  're  going  to  say.  So  I  felt  like  they  anticipate  because  they  already  have  it 
all  figured  out  what  you  're  going  to  say  and  what  their  prognosis  or  diagnosis  of  you  is  and  what  they  think 
about  you.  They  already  have  all  that  planned  out  before  you  even  start  talking  to  them.”  [Usual  Care  Patient] 
"The  leaders  need  more  training  on  how  to  deal  with  us.  They  need  more  training  on  how  not  to  call  us  out 
about  our  issues  or  calling  us  weak.  I  think  they  need  training  because  the  ones  saying  these  things  need  help 
themselves.  I  think  training  the  leaders  is  the  first  step  and  then  training  the  soldiers  with  the  families  is 
important  too.”  [Enhanced  Collaborative  Care  Patient] 


"Educate  commands  to  encourage  their  soldiers  to  go  get  help.  Or  even  bring  in— I  know  when  I  was  in  []  my 
first  tour,  we  had  somebody  come  in  one  day  when  the  whole  group  was  there  and  just  kind  of  give  us  a  overall 
kind  of  class  on,  you  know,  different  things  that  could  have  been  going  on  and  just  kind  of  a  gateway  to,  okay, 
well,  that's  going  on  in  my  life.  Maybe  I  should  set  up  an  appointment.”  [  Enhanced  Collaborative  Care  Patient] 


"It  has  to  start  from  the  top.  It  has  to  be  something  from  way  high  up  to  come  down  to  say,  "Hey,  this  is...  "-you 
know,  they-pretty  much  they  have  to  figure  out  how  to  make  the  units--at  the  highest  level,  make  the  lowest 
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level  [unit  leaders]  understand  that  something's  got  to  be  done  in  certain  situations  or  [telling  them  that] 


needing  help  is  okay."  [Usual  Care  Patient] 

"The  better  the  chain  of  command  is  with  their  support,  the  easier  is  it  for  the  soldiers  to  make  them  want  to  go 
to  it-or  not  make  them-encourage  them  to  go  to  these  services  that  the  Army  has  available."  [Enhanced 
Collaborative  Care  Patient] 

Encourage  "I  feel  like — like  if  I  had  an  appointment  tomorrow  and  I  feel  like  one  of  the  people,  providers  should  have  one  of 

Communication  these  nurses  or  somebody  send  out  an  email  to  my  chain  of  command,  be  like has  an  appointment  tomorrow. 

Between  Providers  and  Please  allow _ to  come,  or  something  like  that."  [Usual  Care  Patient] 

Command 

" Maybe  a  send  a  letter  out  to  them  [leadership/command] ,  explaining  what  the  program  is  about  and  stuff  like 
that  because  I  don 't  think  anybody  really  knows  about  [this  program]  unless  you  go  through  [the  medical  clinic] 
and  stuff  like  that.  Like  all  they  know  about  is  behavioral  health.  They  don't  have  any  idea  about  STEPS-UP." 
[Enhanced  Collaborative  Care  Patient] 
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